-- Logs begin at Tue 2021-11-16 15:35:57 UTC, end at Tue 2021-11-16 16:38:32 UTC. -- Nov 16 16:06:45.032846 dv-cinder-787764-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 16:06:45.046457 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 16:06:45 2021] *** Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: nodename: dv-cinder-787764-5-iscsi Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: machine: x86_64 Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: clock source: unix Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: pcre jit disabled Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: detected number of CPU cores: 4 Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: current working directory: / Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: detected binary path: /usr/bin/uwsgi-core Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: your processes number limit is 47680 Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: your memory page size is 4096 bytes Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: detected max file descriptor number: 2048 Nov 16 16:06:45.047589 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: lock engine: pthread robust mutexes Nov 16 16:06:45.048491 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: thunder lock: enabled Nov 16 16:06:45.048491 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 16:06:45.048491 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 16:06:45.092009 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: Python main interpreter initialized at 0x55cbdeefb9c0 Nov 16 16:06:45.092009 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: python threads support enabled Nov 16 16:06:45.092009 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: your server socket listen backlog is limited to 100 connections Nov 16 16:06:45.092009 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: your mercy for graceful operations on workers is 90 seconds Nov 16 16:06:45.092396 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 16:06:45.092396 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: *** Operational MODE: preforking *** Nov 16 16:06:45.092686 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: *** uWSGI is running in multiple interpreter mode *** Nov 16 16:06:45.092686 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: spawned uWSGI master process (pid: 101207) Nov 16 16:06:45.092906 dv-cinder-787764-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 16:06:45.094024 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: spawned uWSGI worker 1 (pid: 101208, cores: 1) Nov 16 16:06:45.094024 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: spawned uWSGI worker 2 (pid: 101209, cores: 1) Nov 16 16:06:45.094024 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 16:06:46.697561 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:06:46.697561 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: from cryptography.utils import int_from_bytes Nov 16 16:06:46.698214 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:06:46.698214 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: from cryptography.utils import int_from_bytes Nov 16 16:06:46.703245 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:06:46.703245 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: from cryptography.utils import int_from_bytes Nov 16 16:06:46.703797 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:06:46.703797 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: from cryptography.utils import int_from_bytes Nov 16 16:06:49.205873 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 16:06:49.206526 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 16:06:49.206625 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 16:06:49.206978 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 16:06:49.207233 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 16:06:49.207613 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.207931 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.208253 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.208560 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.208883 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.209191 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.209487 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.209797 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.210119 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.210403 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.210704 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.211033 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787764-5-iscsi {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.211349 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.211648 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.211751 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 16:06:49.212139 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 16:06:49.212229 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.212229 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.212376 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 16:06:49.212545 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.212738 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 16:06:49.212831 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.212999 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 16:06:49.213132 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.213396 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.213627 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.213779 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.214047 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.214357 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.214493 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.214698 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.214882 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.215080 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.215313 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.215446 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.215568 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.215689 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.215872 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.216011 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.216206 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.216330 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.216471 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.216604 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.216795 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.216935 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.217135 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787764-5-iscsi {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.217274 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.217465 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.217573 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787764-5-iscsi {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.217791 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.217905 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.218103 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.218206 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.218440 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.218559 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.218754 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.218898 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.219090 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.219249 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.219401 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.219538 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.219734 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.219892 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.220051 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.220207 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.220356 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.220518 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.220677 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.220836 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.220992 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.221184 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.221307 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.221504 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.221623 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.221822 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.221912 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.222147 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.222249 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.222488 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.222576 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.222818 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.222914 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.223116 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.223201 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.223415 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.223534 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787764-5-iscsi {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.223662 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.223856 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.223966 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.224177 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.224278 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.224494 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.224581 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.224895 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.224985 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.225144 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.225233 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.225390 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.225491 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.225709 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.225803 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.226024 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.226120 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.226329 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.226441 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.226658 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.226757 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.226961 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.227053 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.227263 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.227377 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.227564 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.227709 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.227873 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.228023 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.228177 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.228343 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.228484 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.228662 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.228795 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.228981 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.229106 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.229290 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.229421 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.229596 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.229724 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.229849 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.230039 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.230158 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.230517 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.230616 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.230769 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.230941 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.231077 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.231357 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.231460 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.231617 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.231712 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.231872 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.231994 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.232195 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.232291 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.232520 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.232608 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.232834 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.232920 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.233148 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.233235 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.233464 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.233560 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.233776 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.233870 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.234088 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.234181 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.234406 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.234494 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.234661 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.234749 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.234963 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.235051 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.235264 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.235357 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.235578 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.235673 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.235880 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.235968 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.236181 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.236267 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.236487 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.236584 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.236783 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.236924 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.237085 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.237172 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.237388 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.237488 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.237698 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.237785 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.238000 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.238086 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.238301 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.238430 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.238632 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.238740 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.238940 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.239047 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.239243 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.239334 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.239544 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.239642 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.239859 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.239971 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.240179 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.240286 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.240485 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.240575 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.240787 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.240873 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.241079 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.241171 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.241381 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.241481 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.241684 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.241776 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.241988 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.242075 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.242291 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.242412 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.242623 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.242710 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.242922 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.243009 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.243223 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.243309 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.243530 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.243614 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.243828 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.243916 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.244130 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.244331 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.244423 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.244508 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.244725 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.244813 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.245023 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.245116 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.245330 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.245423 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.245628 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.245722 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.245942 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.246094 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.246290 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.246420 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.246617 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.246855 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.246943 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.247203 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.247300 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.247505 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.247593 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.247802 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.247889 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.248099 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.248460 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.248566 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.248674 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.248812 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.248897 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.249005 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.249091 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.249307 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.249394 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.249609 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.249694 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.249918 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.250011 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.250238 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.250370 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.250581 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.250678 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.250892 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.250987 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.251215 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.251309 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.251522 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.251615 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.251834 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.251929 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.252142 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.252234 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.252448 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.252539 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.252755 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.252852 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.253065 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.253151 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.253369 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.253454 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.253671 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.253773 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.253974 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.254059 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.254276 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.254367 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.254611 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.254704 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.254916 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.255009 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.255227 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.255312 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.255538 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.255625 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.255848 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.255934 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.256150 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.256235 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.256457 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.256543 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.256780 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.256872 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:06:49.257095 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.257188 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.257404 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.257489 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.257736 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.257822 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.258067 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.258159 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.258432 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.258546 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.258711 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.258798 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.259017 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.259120 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.259331 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.259418 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.259642 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.259729 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.259949 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.260048 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.260258 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.260353 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.260575 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.260664 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.260880 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.260974 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.261185 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.261271 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.261503 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.261687 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.261838 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.261938 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.262150 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.262372 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.262479 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.262723 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.262823 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.263049 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.263143 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.263353 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.263439 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.263651 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.263750 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.263963 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.264056 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.264283 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.264369 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.264589 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.264687 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.264915 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.265003 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.265220 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.265306 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.265526 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.265621 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.265833 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.265920 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.266131 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.266216 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.266459 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.266551 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.266768 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.266855 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.267067 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.267156 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.267381 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.267470 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.267686 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.267780 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.267987 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.268075 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.268302 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.268402 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.268605 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.268691 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.268905 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.269037 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.269203 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.269287 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.269505 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.269592 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.269810 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.269906 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.270116 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.270203 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.270458 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.270591 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.270769 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.270866 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.271072 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.271204 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.271400 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.271486 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.271708 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.271805 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.272021 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.272106 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.272337 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.272422 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.272652 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.272745 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.272965 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.273051 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.273265 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.273351 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.273569 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.273657 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.273867 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.273954 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.274166 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.274260 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.274491 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.274594 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.274801 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.274889 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.275101 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.275197 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.275403 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.275498 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.275702 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.275796 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.276000 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.276096 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.276300 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.276402 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.276614 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.276700 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.276914 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.277011 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.277273 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.277367 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.277611 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.277698 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.277964 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.278111 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.278306 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.278452 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.278641 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.278797 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.278979 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.279138 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.279312 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.279450 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.279634 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.279780 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.279955 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.280110 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.280267 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.280438 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.280580 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.280748 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.280888 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.281061 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.281382 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.281470 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.281549 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.281666 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.281784 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.281977 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.282100 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.282295 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.282412 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.282637 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.282737 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.282947 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.283034 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.283259 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.283345 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.283567 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.283978 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.284191 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.284284 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.284518 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.284604 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.284830 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.284930 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.285135 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.285219 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.285445 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.285538 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.285755 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.285842 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.286070 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.286156 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.286430 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.286534 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.286712 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.286800 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.287019 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.287115 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.287325 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.287425 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.287631 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.287718 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.287939 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.288032 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.288254 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.288339 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.288560 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.288648 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.288873 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.288966 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.289177 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.289275 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.289489 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.289582 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.289790 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.289883 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.290102 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.290197 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.290423 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.290513 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.290737 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.290823 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.291061 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.291159 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.291374 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.291467 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.291678 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.291764 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.291988 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.292089 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.292306 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.292393 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.292614 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.292704 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.292971 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.293126 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.293305 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.293484 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.293610 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.293814 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.293910 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.294132 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.294226 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.294486 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.294578 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.294804 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.294911 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.295119 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.295205 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.295416 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.295500 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.295726 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.295821 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.296031 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.296117 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.296333 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.296420 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.296631 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.296726 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.296940 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.297025 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.297259 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.297343 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.297563 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.297649 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.297881 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.297973 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.298188 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.298274 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.298509 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.298599 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.298809 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.298895 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.299127 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.299214 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.299433 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.299527 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.299734 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.299819 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.300033 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.300127 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.300332 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.300420 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.300668 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.300762 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.300970 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.301064 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.301272 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.301358 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.301577 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.301662 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.301887 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.301981 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.302193 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.302286 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.302523 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.302614 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.302831 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.302931 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.303135 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.303220 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.303449 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.303534 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.303760 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.303853 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.304059 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.304144 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.304362 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.304448 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.304673 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.304760 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.304972 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.305064 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.305276 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.305362 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.305594 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.305681 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.305897 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.305990 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.306204 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.306289 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.306534 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.306626 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.306837 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.306931 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.307150 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.307237 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.307455 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.307551 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.307760 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.308036 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.308199 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.308375 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.308504 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.308738 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.308829 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.309058 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.309251 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.309352 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.309579 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.309669 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.309906 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.309993 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.310222 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.310321 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.310663 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.310799 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.310967 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.311054 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.311270 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.311366 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.311569 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.311662 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.311868 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.311955 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.312175 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.312263 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.312477 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.312563 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.312777 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.312872 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.313108 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.313204 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.313413 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.313500 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.313711 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.313809 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.314007 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.314095 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.314332 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.314488 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.314666 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.314760 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.314971 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.315066 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.315265 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.315359 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.315572 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.315658 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.315869 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.316154 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.316242 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.316477 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.316563 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.316775 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.316868 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.317073 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.317160 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.317371 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.317458 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.317706 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.317802 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.318005 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.318092 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.318335 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.318456 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.318688 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.318791 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.319002 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.319095 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.319319 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.319405 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.319616 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.319714 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.319923 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.320009 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.320221 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.320307 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.320528 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.320623 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.320827 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.320914 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.321133 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.321219 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.321434 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.321521 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.321732 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.321820 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.322037 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.322124 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.322343 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.322462 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.322679 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.322767 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.322985 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.323153 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.323284 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.323380 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.323587 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.323674 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.323886 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.323975 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.324225 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.324338 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.324530 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.324671 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.324827 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.325027 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.325123 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.325341 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.325428 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.325652 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.325739 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.325987 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.326090 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.326291 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.326565 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.326676 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.326762 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.326906 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.327004 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.327206 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.327293 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.327504 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.327590 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.327801 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.327897 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.328105 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.328215 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.328408 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.328525 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.328706 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.328839 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.329020 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.329145 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.329325 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.329461 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.329624 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.329775 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.329923 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.330083 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.330226 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.330425 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.330555 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.330735 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.330854 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.331048 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.331159 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.331364 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.331479 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.331682 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.331789 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.332003 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.332092 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.332310 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.332451 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.332636 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.332725 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.332946 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.333033 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.333241 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.333337 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.333544 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.333636 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.333838 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.333931 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.334139 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.334234 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.334469 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.334557 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.334770 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.334857 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.335068 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.335158 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.335383 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.335477 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.335685 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.335770 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.335988 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.336075 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.336288 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.336372 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.336586 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.336681 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.336894 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.336979 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.337201 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.337287 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.337528 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.337628 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.337833 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.337919 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.338138 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.338222 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.338470 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.338576 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.338779 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.338866 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.339086 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.339171 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.339391 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.339486 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.339710 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.339800 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.340063 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.340157 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.340387 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.340484 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.340695 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.340782 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.340990 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.341076 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.341291 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.341379 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.341594 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.341680 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.341900 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.341988 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.342207 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.342307 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.342536 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.342626 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.342843 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.342930 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.343150 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.343238 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.343448 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.343542 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.343748 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.343834 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.344050 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.344137 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.344354 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.344490 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.344663 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.344758 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.344962 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.345051 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.345263 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.345348 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.345571 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.345666 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.345876 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.345963 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.346188 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.346284 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.346523 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.346632 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.346832 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.346922 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.347148 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.347234 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.347454 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.347549 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.347759 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.347846 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.348078 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.348165 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.348385 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.348472 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.348684 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.348770 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.348991 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.349086 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.349416 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.349514 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.349595 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.349764 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.349872 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.350078 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.350312 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.350434 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.350646 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.350734 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.350959 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.351045 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.351263 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.351361 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.351571 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.351658 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.351880 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.351980 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.352193 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.352279 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.352504 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.352629 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.352805 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.352901 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.353154 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.353239 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.353469 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.353556 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.353783 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.353878 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.354096 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.354187 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.354424 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.354600 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.354726 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.354823 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.355034 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.355122 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.355402 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.355600 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.355700 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.355820 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.355993 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.356137 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.356302 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.356454 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.356621 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.356766 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.356924 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.357096 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.357241 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.357417 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.357652 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.357740 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.357959 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.358050 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.358270 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.358356 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.358648 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.358735 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.358957 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.359043 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.359292 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.359390 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.359612 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.359698 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.359932 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.360018 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.360262 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.360357 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.360571 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.360664 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.360891 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.360978 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.361202 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.361301 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.361520 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.361606 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.361830 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.361914 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.362134 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.362254 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.362480 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.362581 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.362783 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.362900 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.363102 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.363216 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.363420 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.363535 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.363729 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.363843 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.364063 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.364179 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.364443 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.364554 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.364764 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.364884 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.365077 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.365197 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.365394 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.365512 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.365720 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.365831 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.366020 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.366145 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.366320 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.366464 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.366654 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.366956 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.367078 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.367262 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.367375 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.367569 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.367687 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.367869 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.367981 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.368180 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.368292 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.368493 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.368606 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.368791 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.368928 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.369101 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.369199 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.369392 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.369521 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.369703 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.369828 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.370007 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.370148 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.370327 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.370499 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.370662 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.370838 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.371078 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.371237 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.371469 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.371717 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.371796 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.371880 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.372083 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.372172 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.372386 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.372487 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.372695 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.372791 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.372996 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.373083 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.373294 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.373379 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.373635 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.373802 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.374131 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.374252 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.374357 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.374513 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.374607 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.374765 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.374898 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.375097 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.375214 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.375408 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.375541 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.375718 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.375866 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.376032 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.376178 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.376342 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.376493 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.376653 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.376811 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.376977 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.377100 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.377287 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.377410 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.377602 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.377724 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.377916 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.378030 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.378228 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.378360 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.378566 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.378681 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.378867 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.378985 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.379170 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.379284 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.379469 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.379582 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.379768 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.379883 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.380085 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.380199 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.380385 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.380499 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.380700 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.380822 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381005 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381120 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381341 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381432 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381593 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381689 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381903 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.381990 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.382213 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.382299 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.382547 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.382638 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.382872 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.382995 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.383187 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.383283 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.383502 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.383597 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.383826 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.383914 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.384132 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.384223 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.384465 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.384554 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.384787 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.384874 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.385098 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.385185 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.385410 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.385506 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.385722 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.385810 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.386034 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.386132 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.386341 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.386449 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.386702 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.386793 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.387034 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.387134 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.387505 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.387608 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.387761 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.387840 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.388096 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.388182 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.388410 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.388720 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.388837 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.389032 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.389166 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.389339 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.389480 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.389726 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.389814 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.390038 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.390132 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.390364 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.390482 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.390710 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.390796 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.391016 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.391183 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.391310 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.391546 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.391639 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.391915 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.392041 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.392246 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.392335 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.392564 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.392651 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.392887 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.392987 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.393210 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.393299 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.393523 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.393617 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.393834 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.393931 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.394147 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.394241 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.394482 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.394587 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.394818 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.394919 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.395136 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.395222 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.395440 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.395528 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.395753 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.395842 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.396067 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.396154 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.396377 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.396464 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.396691 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.396786 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.396998 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.397092 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.397305 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.397401 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.397613 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.397708 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.397919 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.398007 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.398225 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.398508 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.398612 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.398849 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.398938 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.399165 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.399253 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.399480 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.399573 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.399794 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.399879 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.400103 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.400190 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.400410 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.400505 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.400721 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.400808 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.401032 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.401232 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.401350 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.401545 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.401671 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.401874 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.402006 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.402227 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.402476 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.402602 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.402994 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.403277 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.403375 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.403457 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.403569 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.403648 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.403878 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.403961 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.404181 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.404267 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.404495 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.404580 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.404802 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.404886 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.405102 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.405187 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.405427 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.405512 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.405756 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.405907 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.406077 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.406485 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.406566 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.406813 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.407056 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.407135 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.407437 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.407633 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.407756 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.408073 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.408386 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.408491 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.409030 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.409147 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.409353 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.409470 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.409682 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.409782 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.410023 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.410110 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.410348 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.410459 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.410694 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.410794 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.411014 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.411337 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.411870 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.412190 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.412525 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.412654 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.412855 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.413182 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.413325 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.413506 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.413651 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.413827 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.413979 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.414156 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.414299 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.414494 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.414634 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.414805 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.414946 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.415119 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.415264 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.415430 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.415579 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.415737 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.415886 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.416069 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.416218 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.416383 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.416532 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.416690 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.416858 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.417014 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.417164 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.417326 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.417469 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.417774 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.417912 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.418148 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.418488 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.418621 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.418789 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.419093 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.419181 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.419395 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.419703 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.419809 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.420011 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.420322 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.420409 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.420622 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.420918 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.421261 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.421612 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.421942 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.422273 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.422629 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.422954 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.423268 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.423362 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.423583 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.423678 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.423905 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.424002 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.424223 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.424312 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.424535 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.424622 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.424852 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.425020 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.425164 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.425242 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.425494 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.425580 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.425804 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.425892 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.426113 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.426208 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.426447 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.426577 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.426763 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.426852 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.427071 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.427158 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.427381 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.427470 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.427691 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.427942 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.428032 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.428303 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.428389 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.428613 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.428731 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.428927 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.429023 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.429239 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.429326 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.429556 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.429645 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.429873 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.429960 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.430180 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.430266 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.430518 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.430618 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.430836 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.430931 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.431143 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.431229 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.431452 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.431539 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.431762 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.431893 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.432072 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.432160 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.432382 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.432471 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.432691 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.432800 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.433001 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.433096 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.433311 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.433398 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.433708 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.433800 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.434111 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.434463 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.434565 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.434784 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.434873 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.435102 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.435216 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.435412 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.435501 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.435721 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.435819 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.436031 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.436127 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.436340 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.436434 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.436653 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.436745 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.436983 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.437082 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.437302 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.437399 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.437604 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.437699 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.437925 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.438026 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.438242 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.438337 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.438584 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.438673 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.438903 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.438993 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.439219 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.439328 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.439537 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.439632 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.439850 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.439939 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.440166 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.440253 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.440488 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.440583 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.440799 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.440887 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.441116 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.441203 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.441445 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.441535 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.441760 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.441848 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.442075 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.442162 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.442406 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.442513 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.442700 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.442795 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.443002 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.443090 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.443312 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.443409 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.443640 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.443745 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.443943 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.444029 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.444261 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.444379 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.444573 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.444696 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.444894 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.445020 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.445201 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.445345 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.445527 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.445659 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.445847 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.445986 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.446162 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.446313 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.446500 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.446666 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.446839 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.446993 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.447146 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.447309 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.447459 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.447643 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.447769 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.447984 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.448085 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.448317 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.448405 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.448642 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.448739 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.448951 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.449065 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.449411 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.449500 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.449720 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.449808 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.450032 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.450120 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.450550 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.450631 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.450715 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.450796 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.450996 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.451086 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.451305 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.451401 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.451636 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.451738 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.451948 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.452072 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.452258 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.452345 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.452567 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.452667 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.452877 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.452964 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.453191 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.453278 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.453505 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.453600 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.453822 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.453909 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.454138 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.454226 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.454480 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.454571 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.454795 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.454883 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.455108 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.455203 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.455423 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.455518 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.455755 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.455843 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.456127 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.456224 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.456382 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.456469 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.456688 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.456783 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.456990 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.457076 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.457230 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 16:06:49.457327 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.457627 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.457948 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.458279 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.458619 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.458941 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.459255 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.459570 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.459890 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.460208 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.460542 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.460874 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.461208 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.461536 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.461881 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.462327 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.462707 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.463041 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.463359 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.463676 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.463985 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:06:49.464230 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101209) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 16:06:49.479983 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_db.sqlalchemy.engines [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:49.486826 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_db.sqlalchemy.engines [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:49.550267 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.context [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),539e9b60-8ce1-4f2b-9153-f282c518691a(cell1) {{(pid=101208) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 16:06:49.554831 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.556458 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.556747 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.context [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),539e9b60-8ce1-4f2b-9153-f282c518691a(cell1) {{(pid=101209) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 16:06:49.557266 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.559294 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.561406 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_concurrency.lockutils [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.563139 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_concurrency.lockutils [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.563964 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_concurrency.lockutils [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:06:49.565986 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_concurrency.lockutils [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101209) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:06:49.569937 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_db.sqlalchemy.engines [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:49.572632 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_db.sqlalchemy.engines [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:49.579973 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_db.sqlalchemy.engines [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:49.583185 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_db.sqlalchemy.engines [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:49.841078 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_db.sqlalchemy.engines [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:49.847313 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG oslo_db.sqlalchemy.engines [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101209) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:06:50.183827 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: WARNING keystonemiddleware.auth_token [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:06:50.189253 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: WARNING keystonemiddleware.auth_token [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:06:50.190793 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: WARNING keystonemiddleware.auth_token [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:06:50.195848 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: WARNING keystonemiddleware.auth_token [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:06:50.412839 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: WARNING keystonemiddleware.auth_token [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:06:50.418151 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: WARNING keystonemiddleware.auth_token [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:06:50.418354 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: WARNING keystonemiddleware.auth_token [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:06:50.423557 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: WARNING keystonemiddleware.auth_token [None req-c3a351a2-cbdd-4b36-b76c-2c7c1ca3cefd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:06:50.423692 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbdeefb9c0 pid: 101209 (default app) Nov 16 16:06:50.425684 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:06:50.426893 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Nov 16 16:06:50.427300 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Tue Nov 16 16:06:50 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:06:50.428895 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55cbdeefb9c0 pid: 101208 (default app) Nov 16 16:08:12.217226 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:12.218167 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 16 16:08:12.218786 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:12.798796 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-50bb6076-2508-45d1-8a8b-b0543ca7e769 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:12.828331 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-50bb6076-2508-45d1-8a8b-b0543ca7e769 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.601883 Nov 16 16:08:12.830440 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Nov 16 16:08:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:15.126918 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:15.127932 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-e977e662-2f45-44ee-88fd-20f56a922432 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Nov 16 16:08:15.128293 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:15.201197 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-fefd4008-c659-4700-8e99-23f8ce39e331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:15.220154 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:15.220154 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: warnings.warn(msg) Nov 16 16:08:15.250337 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-fefd4008-c659-4700-8e99-23f8ce39e331 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114321 Nov 16 16:08:15.251269 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:15 2021] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:15.608290 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-67e1ee8f-f5f5-451a-ac5d-1bf70de0e2d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:15.610684 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:15.610684 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: warnings.warn(msg) Nov 16 16:08:15.664486 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-67e1ee8f-f5f5-451a-ac5d-1bf70de0e2d5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.404747 Nov 16 16:08:15.665069 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Nov 16 16:08:15 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:17.974275 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-fefd4008-c659-4700-8e99-23f8ce39e331 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:17.975345 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-fefd4008-c659-4700-8e99-23f8ce39e331 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Nov 16 16:08:17.975753 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:18.096514 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-2d3d9cc2-3ab5-4543-a489-1bea3ab70bfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "swap": 0, "id": "d1"}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:18.114166 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:18.114166 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: warnings.warn(msg) Nov 16 16:08:18.134717 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-2d3d9cc2-3ab5-4543-a489-1bea3ab70bfe admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.151613 Nov 16 16:08:18.135290 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:18.147778 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-0881e2b3-817f-4527-8799-a43d8df03055 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:18.149662 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:08:18.149662 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: warnings.warn(msg) Nov 16 16:08:18.188677 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-0881e2b3-817f-4527-8799-a43d8df03055 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044563 Nov 16 16:08:18.189541 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Nov 16 16:08:18 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:20.548561 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-2d3d9cc2-3ab5-4543-a489-1bea3ab70bfe admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:20.550838 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-2d3d9cc2-3ab5-4543-a489-1bea3ab70bfe admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002661 Nov 16 16:08:20.551818 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:20 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:20.630816 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-a7efe2b5-1996-4bfc-9f60-f379522c75f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "id": "d2", "ram": 1024, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:20.654432 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-a7efe2b5-1996-4bfc-9f60-f379522c75f9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.095060 Nov 16 16:08:20.655406 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:20 2021] POST /compute/v2.1/flavors => generated 404 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:20.668398 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-01c3e733-88de-4914-aa0e-dd797a185f8e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:20.692427 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-01c3e733-88de-4914-aa0e-dd797a185f8e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027733 Nov 16 16:08:20.693064 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Nov 16 16:08:20 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:23.019519 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-a7efe2b5-1996-4bfc-9f60-f379522c75f9 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:23.021150 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-a7efe2b5-1996-4bfc-9f60-f379522c75f9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Nov 16 16:08:23.021559 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:23.093311 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-d8dee033-9952-4c09-b630-a54b16014edd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "disk": 10, "ram": 2048}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:23.112739 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-d8dee033-9952-4c09-b630-a54b16014edd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083585 Nov 16 16:08:23.113293 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:23.125875 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-1d952387-c429-4494-80c8-baf718347e84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:23.149199 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-1d952387-c429-4494-80c8-baf718347e84 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027087 Nov 16 16:08:23.149776 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Nov 16 16:08:23 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:25.463711 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-d8dee033-9952-4c09-b630-a54b16014edd admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:25.464708 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-d8dee033-9952-4c09-b630-a54b16014edd admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001691 Nov 16 16:08:25.465262 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:25.535497 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-e49b7e76-435d-4292-924d-32784187f1e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:25.562224 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-e49b7e76-435d-4292-924d-32784187f1e9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090131 Nov 16 16:08:25.562822 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:25 2021] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:25.575670 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-8ba14867-9fe5-4e7f-9892-60478941a935 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:25.600498 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-8ba14867-9fe5-4e7f-9892-60478941a935 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028899 Nov 16 16:08:25.601079 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Tue Nov 16 16:08:25 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:28.060922 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-e49b7e76-435d-4292-924d-32784187f1e9 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:28.062062 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-e49b7e76-435d-4292-924d-32784187f1e9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Nov 16 16:08:28.062630 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:28.127080 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-abde79d7-6fb8-497b-b416-4056f2a91366 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:28.152030 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-abde79d7-6fb8-497b-b416-4056f2a91366 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080581 Nov 16 16:08:28.152610 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Nov 16 16:08:28 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:08:30.479782 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-e49b7e76-435d-4292-924d-32784187f1e9 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:30.480892 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-e49b7e76-435d-4292-924d-32784187f1e9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 16 16:08:30.481399 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:08:30.581554 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-a74ffab0-e83d-4f34-b2e7-29afec9110c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1"}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:30.602386 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-a74ffab0-e83d-4f34-b2e7-29afec9110c0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.113255 Nov 16 16:08:30.603007 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:30 2021] POST /compute/v2.1/flavors => generated 402 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:30.616500 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-09345889-5379-4fe9-9730-f4da207b8450 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:30.644520 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-09345889-5379-4fe9-9730-f4da207b8450 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031461 Nov 16 16:08:30.644860 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Nov 16 16:08:30 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:33.058829 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-a74ffab0-e83d-4f34-b2e7-29afec9110c0 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:33.060268 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-a74ffab0-e83d-4f34-b2e7-29afec9110c0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002207 Nov 16 16:08:33.060651 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:33.126323 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-17ed7599-18c7-4351-a5b9-7e0b513afc17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "2"}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:33.145828 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-17ed7599-18c7-4351-a5b9-7e0b513afc17 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076896 Nov 16 16:08:33.146432 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:33 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:33.159744 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-9492208b-7d33-447a-99b2-0deb50e70103 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:33.183771 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-9492208b-7d33-447a-99b2-0deb50e70103 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027945 Nov 16 16:08:33.184417 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Nov 16 16:08:33 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:08:35.516346 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-17ed7599-18c7-4351-a5b9-7e0b513afc17 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:35.517361 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-17ed7599-18c7-4351-a5b9-7e0b513afc17 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Nov 16 16:08:35.517772 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:35.574668 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-55498d14-8992-4230-9c47-1b660e2d3ade admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "swap": 0, "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:35.594931 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-55498d14-8992-4230-9c47-1b660e2d3ade admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070089 Nov 16 16:08:35.595484 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:35 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:35.608537 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-3f8e3870-383f-491c-9042-dccefc24f82a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:35.632801 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-3f8e3870-383f-491c-9042-dccefc24f82a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028373 Nov 16 16:08:35.633419 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Nov 16 16:08:35 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:37.967106 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-55498d14-8992-4230-9c47-1b660e2d3ade admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:37.968111 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-55498d14-8992-4230-9c47-1b660e2d3ade admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Nov 16 16:08:37.968518 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:38.032135 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-7cafa266-6b6f-493d-b650-ac1e133cc19a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4, "name": "m1.large"}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:38.051161 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-7cafa266-6b6f-493d-b650-ac1e133cc19a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076098 Nov 16 16:08:38.052061 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:37 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:08:38.065130 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-ce016ee9-06e9-4728-9c44-5414920d0659 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:38.089662 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-ce016ee9-06e9-4728-9c44-5414920d0659 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028497 Nov 16 16:08:38.090344 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Nov 16 16:08:38 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:08:40.455600 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-7cafa266-6b6f-493d-b650-ac1e133cc19a admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:08:40.457389 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-7cafa266-6b6f-493d-b650-ac1e133cc19a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002240 Nov 16 16:08:40.464018 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:08:40 2021] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:08:40.521389 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-fe47439d-8f87-4bd1-bcf5-7ee4378b7bf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:40.543084 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-fe47439d-8f87-4bd1-bcf5-7ee4378b7bf2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077560 Nov 16 16:08:40.543641 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Tue Nov 16 16:08:40 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:08:40.556136 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-4feb4d29-4c1f-4682-a0d3-71f893629067 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:08:40.583951 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-4feb4d29-4c1f-4682-a0d3-71f893629067 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031319 Nov 16 16:08:40.584658 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Tue Nov 16 16:08:40 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:09:20.080042 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-fe47439d-8f87-4bd1-bcf5-7ee4378b7bf2 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:20.081657 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-fe47439d-8f87-4bd1-bcf5-7ee4378b7bf2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002319 Nov 16 16:09:20.082317 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:09:20 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:20.149724 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-cbd19163-e2ca-4fad-9159-585e3be49b67 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:20.167455 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-cbd19163-e2ca-4fad-9159-585e3be49b67 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076869 Nov 16 16:09:20.168003 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Nov 16 16:09:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:21.706684 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-fe47439d-8f87-4bd1-bcf5-7ee4378b7bf2 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:21.707696 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-fe47439d-8f87-4bd1-bcf5-7ee4378b7bf2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Nov 16 16:09:21.708099 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:21.911656 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-2fe7b2cc-a087-40d2-9118-18201ccf7942 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:21.917446 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.wsgi [None req-2fe7b2cc-a087-40d2-9118-18201ccf7942 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 16:09:21.918021 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-2fe7b2cc-a087-40d2-9118-18201ccf7942 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:21.918851 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-2fe7b2cc-a087-40d2-9118-18201ccf7942 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070534 Nov 16 16:09:21.919358 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Nov 16 16:09:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 16:09:21.929489 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-07c9c999-c92e-43a7-809d-c05cdb31b47d admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:21.950732 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-07c9c999-c92e-43a7-809d-c05cdb31b47d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024773 Nov 16 16:09:21.951283 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Nov 16 16:09:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:21.961505 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-94f5e30a-9085-4729-84b5-d79e9401f863 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:21.983018 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-94f5e30a-9085-4729-84b5-d79e9401f863 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024985 Nov 16 16:09:21.983557 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Nov 16 16:09:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:21.993815 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-5469da50-6f63-4e2f-a586-1ef3fd8a72c4 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:21.999896 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.wsgi [None req-5469da50-6f63-4e2f-a586-1ef3fd8a72c4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 16 16:09:22.000463 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-5469da50-6f63-4e2f-a586-1ef3fd8a72c4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:22.001255 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-5469da50-6f63-4e2f-a586-1ef3fd8a72c4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011093 Nov 16 16:09:22.001771 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Nov 16 16:09:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 16:09:23.412968 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-94f5e30a-9085-4729-84b5-d79e9401f863 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:23.413973 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-94f5e30a-9085-4729-84b5-d79e9401f863 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Nov 16 16:09:23.414370 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:23 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:23.615665 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-f7557030-e4b8-4e0f-9e24-ce18e29d6fe4 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:23.622420 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.wsgi [None req-f7557030-e4b8-4e0f-9e24-ce18e29d6fe4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 16:09:23.623011 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-f7557030-e4b8-4e0f-9e24-ce18e29d6fe4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:23.623830 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-f7557030-e4b8-4e0f-9e24-ce18e29d6fe4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070937 Nov 16 16:09:23.624420 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Nov 16 16:09:23 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 16:09:23.635093 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-17ac339f-547d-4833-a2a7-6efb1e542bc1 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:23.648903 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-17ac339f-547d-4833-a2a7-6efb1e542bc1 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017581 Nov 16 16:09:23.649465 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Nov 16 16:09:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:23.660571 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-4bed7ac6-b17e-414f-9912-ab9391d9cfbb admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:23.675401 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-4bed7ac6-b17e-414f-9912-ab9391d9cfbb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018589 Nov 16 16:09:23.675966 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Nov 16 16:09:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:23.686611 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-0d07bcba-3d67-4f47-a1cc-8efa5f5f86a0 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:23.692065 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.wsgi [None req-0d07bcba-3d67-4f47-a1cc-8efa5f5f86a0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 16 16:09:23.692627 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-0d07bcba-3d67-4f47-a1cc-8efa5f5f86a0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:23.693406 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-0d07bcba-3d67-4f47-a1cc-8efa5f5f86a0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010446 Nov 16 16:09:23.693909 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Nov 16 16:09:23 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 16:09:25.086692 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-4bed7ac6-b17e-414f-9912-ab9391d9cfbb admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:25.087747 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-4bed7ac6-b17e-414f-9912-ab9391d9cfbb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001597 Nov 16 16:09:25.088296 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:25 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:25.294822 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-b5aa887c-d970-4120-959d-b8b2f8c40e96 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:25.300463 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.wsgi [None req-b5aa887c-d970-4120-959d-b8b2f8c40e96 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 16:09:25.301023 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-b5aa887c-d970-4120-959d-b8b2f8c40e96 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:25.301812 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-b5aa887c-d970-4120-959d-b8b2f8c40e96 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.073194 Nov 16 16:09:25.302298 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Nov 16 16:09:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 16:09:25.312685 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-3cce32bd-a2bc-44dd-8096-0d7d0e9c4896 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:25.327131 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-3cce32bd-a2bc-44dd-8096-0d7d0e9c4896 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018099 Nov 16 16:09:25.327674 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Nov 16 16:09:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:09:25.338579 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:25.352356 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017881 Nov 16 16:09:25.352853 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Nov 16 16:09:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:09:25.363092 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-5a629b92-9e50-486a-a0bf-22a699d59b29 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:25.368604 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.wsgi [None req-5a629b92-9e50-486a-a0bf-22a699d59b29 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 16 16:09:25.369185 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-5a629b92-9e50-486a-a0bf-22a699d59b29 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101209) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:09:25.369970 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-5a629b92-9e50-486a-a0bf-22a699d59b29 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010491 Nov 16 16:09:25.370511 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Nov 16 16:09:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 16 16:09:26.757704 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:26.758746 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Nov 16 16:09:26.759141 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:26.955647 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-8d6555aa-8cfa-4e45-a511-eae3da3affea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:26.982861 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-8d6555aa-8cfa-4e45-a511-eae3da3affea admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086802 Nov 16 16:09:26.983716 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Nov 16 16:09:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:28.367489 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:28.368512 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 16 16:09:28.368912 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:28.564880 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-2fa9f30d-6cd3-45bc-a69c-df7b4f2ddffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:28.592491 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-2fa9f30d-6cd3-45bc-a69c-df7b4f2ddffd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.084878 Nov 16 16:09:28.592955 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Nov 16 16:09:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:29.978523 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:29.979546 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Nov 16 16:09:29.979943 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:30.183631 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-bca0e5cd-8904-4aa9-8f80-8fca0c5fe880 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:30.204561 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-bca0e5cd-8904-4aa9-8f80-8fca0c5fe880 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.086871 Nov 16 16:09:30.205123 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Nov 16 16:09:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:31.616303 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:31.617316 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Nov 16 16:09:31.617716 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:31.841183 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-b00c8c49-c0c3-45f1-9473-978d1764f6bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:09:31.866754 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-b00c8c49-c0c3-45f1-9473-978d1764f6bc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.096708 Nov 16 16:09:31.867291 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Nov 16 16:09:31 2021] POST /compute/v2.1/flavors => generated 409 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:09:33.249309 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:33.250658 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Nov 16 16:09:33.251165 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:09:33 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:09:33.448015 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-f5335e84-80f3-43ab-9cf2-5e2aca1675fb admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:09:33.467261 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-f5335e84-80f3-43ab-9cf2-5e2aca1675fb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078369 Nov 16 16:09:33.467713 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Nov 16 16:09:33 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:20.535860 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:20.537000 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-c2a54024-ec02-44ea-858e-c6437f2b0db7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Nov 16 16:10:20.537406 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Tue Nov 16 16:10:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:10:20.597579 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-805b9a33-4b44-4dce-ada8-ec27414469e9 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:20.622177 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-805b9a33-4b44-4dce-ada8-ec27414469e9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077519 Nov 16 16:10:20.622938 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Tue Nov 16 16:10:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:10:20.649618 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-038b0d49-5579-4156-8100-22d623b20ae1 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:20.658623 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-038b0d49-5579-4156-8100-22d623b20ae1 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012681 Nov 16 16:10:20.659153 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Tue Nov 16 16:10:20 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:20.671461 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-9b0feb2e-41f7-4b38-88b5-4f5fb3f27c3f admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:20.679432 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-9b0feb2e-41f7-4b38-88b5-4f5fb3f27c3f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011553 Nov 16 16:10:20.679969 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Tue Nov 16 16:10:20 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:20.692305 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-4d1cbe60-e70b-47e8-9995-d413c4d2514c admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:20.700632 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-4d1cbe60-e70b-47e8-9995-d413c4d2514c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012075 Nov 16 16:10:20.701146 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Tue Nov 16 16:10:20 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:10:20.713731 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:10:20.721962 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011753 Nov 16 16:10:20.722518 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Tue Nov 16 16:10:20 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:11:51.030994 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-3688eea5-9e95-4298-b4a4-6250bbb4ae5b tempest-verify_tempest_config-623582468 tempest-verify_tempest_config-623582468-project] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:11:51.033119 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-3688eea5-9e95-4298-b4a4-6250bbb4ae5b tempest-verify_tempest_config-623582468 tempest-verify_tempest_config-623582468-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.124518 Nov 16 16:11:51.033652 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 34/69] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Nov 16 16:11:50 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:13:22.404268 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:22.405581 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001688 Nov 16 16:13:22.405995 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 36/70] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:13:22 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:22.680137 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-2c0c6135-5fa9-412f-9f11-2f2fb5dc05e2 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:22.681717 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:22.681717 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: warnings.warn(msg) Nov 16 16:13:22.684008 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-2c0c6135-5fa9-412f-9f11-2f2fb5dc05e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:22.684497 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-2c0c6135-5fa9-412f-9f11-2f2fb5dc05e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:22.685507 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-2c0c6135-5fa9-412f-9f11-2f2fb5dc05e2 admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:22.686106 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-2c0c6135-5fa9-412f-9f11-2f2fb5dc05e2 admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:22.719832 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-2c0c6135-5fa9-412f-9f11-2f2fb5dc05e2 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.170520 Nov 16 16:13:22.720403 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 35/71] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Nov 16 16:13:22 2021] GET /compute/v2.1/os-services => generated 791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:13:24.172114 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:24.173114 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Nov 16 16:13:24.173508 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 37/72] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:13:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:24.384314 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-51792b8f-746c-4685-871f-94ab87e00311 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:24.385487 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:24.385487 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: warnings.warn(msg) Nov 16 16:13:24.387122 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-51792b8f-746c-4685-871f-94ab87e00311 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:24.387555 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-51792b8f-746c-4685-871f-94ab87e00311 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:24.388347 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-51792b8f-746c-4685-871f-94ab87e00311 admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:24.388809 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-51792b8f-746c-4685-871f-94ab87e00311 admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:24.408548 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-51792b8f-746c-4685-871f-94ab87e00311 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.093875 Nov 16 16:13:24.409097 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 36/73] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Nov 16 16:13:24 2021] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:13:36.274516 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:36.275566 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Nov 16 16:13:36.275968 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 38/74] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:13:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:36.487877 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-798fa019-1aee-4b5f-be09-b5a7d7ccfbb2 admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:36.489022 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:36.489022 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: warnings.warn(msg) Nov 16 16:13:36.490554 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-798fa019-1aee-4b5f-be09-b5a7d7ccfbb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:36.490991 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-798fa019-1aee-4b5f-be09-b5a7d7ccfbb2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:36.491763 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-798fa019-1aee-4b5f-be09-b5a7d7ccfbb2 admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:36.492185 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-798fa019-1aee-4b5f-be09-b5a7d7ccfbb2 admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:36.516450 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-798fa019-1aee-4b5f-be09-b5a7d7ccfbb2 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.097755 Nov 16 16:13:36.516996 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 37/75] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Nov 16 16:13:36 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:13:37.944874 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: DEBUG nova.api.openstack.wsgi [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] Calling method '>' {{(pid=101209) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:37.945883 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: INFO nova.api.openstack.requestlog [None req-988fd31e-e986-4d33-ac20-0a14fa7cd3f5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Nov 16 16:13:37.946284 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: [pid: 101209|app: 0|req: 39/76] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Nov 16 16:13:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:13:38.151427 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG nova.api.openstack.wsgi [None req-e97013bd-9516-4e28-9b50-c6508a138d4c admin admin] Calling method '>' {{(pid=101208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:13:38.153321 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:13:38.153321 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: warnings.warn(msg) Nov 16 16:13:38.155610 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-e97013bd-9516-4e28-9b50-c6508a138d4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:38.156201 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-e97013bd-9516-4e28-9b50-c6508a138d4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:38.157327 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-e97013bd-9516-4e28-9b50-c6508a138d4c admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:13:38.158006 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: DEBUG oslo_concurrency.lockutils [None req-e97013bd-9516-4e28-9b50-c6508a138d4c admin admin] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:13:38.181623 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: INFO nova.api.openstack.requestlog [None req-e97013bd-9516-4e28-9b50-c6508a138d4c admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092555 Nov 16 16:13:38.182162 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: [pid: 101208|app: 0|req: 38/77] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Nov 16 16:13:38 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:14:34.965164 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: Tue Nov 16 16:14:34 2021 - graceful shutdown triggered... Nov 16 16:14:34.964862 dv-cinder-787764-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 16 16:14:34.966187 dv-cinder-787764-5-iscsi devstack@n-api.service[101208]: Gracefully killing worker 1 (pid: 101208)... Nov 16 16:14:34.966914 dv-cinder-787764-5-iscsi devstack@n-api.service[101209]: Gracefully killing worker 2 (pid: 101209)... Nov 16 16:14:35.965742 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: worker 1 buried after 1 seconds Nov 16 16:14:35.965742 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: worker 2 buried after 1 seconds Nov 16 16:14:35.965742 dv-cinder-787764-5-iscsi devstack@n-api.service[101207]: goodbye to uWSGI. Nov 16 16:14:35.968401 dv-cinder-787764-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 16 16:14:35.969290 dv-cinder-787764-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 16 16:14:35.973543 dv-cinder-787764-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 16 16:14:35.985377 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 16:14:35 2021] *** Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: nodename: dv-cinder-787764-5-iscsi Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: machine: x86_64 Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: clock source: unix Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: pcre jit disabled Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: detected number of CPU cores: 4 Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: current working directory: / Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: detected binary path: /usr/bin/uwsgi-core Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: your processes number limit is 47680 Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: your memory page size is 4096 bytes Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: detected max file descriptor number: 2048 Nov 16 16:14:35.987680 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: lock engine: pthread robust mutexes Nov 16 16:14:35.988773 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: thunder lock: enabled Nov 16 16:14:35.988773 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 16 16:14:35.988773 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 16:14:36.039906 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: Python main interpreter initialized at 0x5627ee75b9c0 Nov 16 16:14:36.039906 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: python threads support enabled Nov 16 16:14:36.039906 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: your server socket listen backlog is limited to 100 connections Nov 16 16:14:36.039906 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: your mercy for graceful operations on workers is 90 seconds Nov 16 16:14:36.040362 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 16:14:36.040447 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: *** Operational MODE: preforking *** Nov 16 16:14:36.044073 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: *** uWSGI is running in multiple interpreter mode *** Nov 16 16:14:36.044073 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: spawned uWSGI master process (pid: 116153) Nov 16 16:14:36.044342 dv-cinder-787764-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 16 16:14:36.045066 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: spawned uWSGI worker 1 (pid: 116167, cores: 1) Nov 16 16:14:36.045066 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: spawned uWSGI worker 2 (pid: 116168, cores: 1) Nov 16 16:14:36.045253 dv-cinder-787764-5-iscsi devstack@n-api.service[116153]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 16:14:37.814749 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:14:37.814749 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: from cryptography.utils import int_from_bytes Nov 16 16:14:37.815497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:14:37.815497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: from cryptography.utils import int_from_bytes Nov 16 16:14:37.823579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:14:37.823579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: from cryptography.utils import int_from_bytes Nov 16 16:14:37.824219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 16:14:37.824219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: from cryptography.utils import int_from_bytes Nov 16 16:14:40.194282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 16:14:40.194876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 16:14:40.195032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 16:14:40.195419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 16:14:40.195673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 16:14:40.196059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.196403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.196710 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.197027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.197359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.197666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.197994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.198312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.198681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.198931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.199248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.199582 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787764-5-iscsi {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.199891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.200197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.200507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.200825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.201130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.201451 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.201758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.202259 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.204237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.204932 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.205675 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.206240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.206994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.207820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.208644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.209176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.209537 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.209871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.210310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787764-5-iscsi {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.210672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.211003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.211332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.211769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.212089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.212426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.212736 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.213066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.213381 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.213712 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.214037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.214361 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.214706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.215013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.215325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.215640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.215965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.216272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.216580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.216835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.217145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.217467 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.217790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.218112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.218368 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.218640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.218958 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.219287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.219599 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.219910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.220220 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.220528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.220835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.221142 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.221449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.221757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.222132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.222462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.222789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.223095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.223416 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.223816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.224069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.224379 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.224719 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.225037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.225347 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.225671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.225997 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.226306 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.226658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.226970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.227288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.227629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.227927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.228182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.228484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.228793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.229116 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.229424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.229732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.229830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 16:14:40.230242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.230373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 16:14:40.230508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.230650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.230755 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 16:14:40.230962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.231115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 16:14:40.231263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.231372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 16:14:40.231568 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.231808 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.232001 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.232170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.232262 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.232478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.232601 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.232784 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.233018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.233098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.233388 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.233477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.233705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.233800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.234499 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.234610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.234687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.234769 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.234842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.234919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.234919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.235054 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.235221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.235319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.235529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.235608 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-787764-5-iscsi {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.235834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.235949 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.236196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.236303 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.236461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.236564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.236767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.236848 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.237084 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.237177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.237659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.237764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.237846 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.237973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.238050 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.238318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.238652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.238759 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.239009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.239172 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.239276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.239390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.239595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.239705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.239935 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.240065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.240199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.240374 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.240562 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.240687 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.240786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.241005 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.241105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.241313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.241412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.241635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.241740 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.241944 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.242136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.242304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.242853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-787764-5-iscsi {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.242960 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.242960 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.243125 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.243529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.243669 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.243744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.243815 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.243915 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.244143 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.244263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.244471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.244563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.244785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.244881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.245107 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.245219 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.245431 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.245528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.245740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.245830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.246057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.246175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.246407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.246543 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.246739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.246884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.247036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.247129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.247426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.247532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.247736 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.247835 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.248061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.248160 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.248393 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.248518 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.248721 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.249101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.249317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.249427 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.249523 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.249629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.249722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.249965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.250066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.250260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.250361 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.250650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.250756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.251012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.251130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.251255 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.251348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.251625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.251738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.251930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.252035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.252244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.252342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.252551 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.252654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.252857 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.252949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.253162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.253253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.253601 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.253745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.254045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.254192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.254364 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.254571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.254726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.254887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.255050 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.255209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.255352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.255491 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.255632 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.255802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.255962 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.256117 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.256294 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.256462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.256592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.256691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.256945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.257049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.257212 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.257305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.257498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.257607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.257832 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.257953 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.258151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.258309 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.258508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.258617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.258849 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.258950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.259102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.259207 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.259416 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.259507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.259707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.259841 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.260039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.260157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.260322 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.260430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.260642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.260805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.260953 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.261115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.261276 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.261441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.261584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.261741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.261898 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.262066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.262182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.262270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.262363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.262487 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.262658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.262764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.262961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.263140 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.263243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.263516 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.263620 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.263831 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.264035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.264131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.264415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.264576 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.264721 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.265022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.265115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.265323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.265666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.265765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.265967 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.266263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.266410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.266647 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.266948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.267093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.267199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.267615 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.267750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.267855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.268136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.268362 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.268459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.268723 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.268860 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.269147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.269337 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.269477 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.269795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.269938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.270133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.270452 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.270587 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.270761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.271086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.271197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.271382 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.271684 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.271787 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.271997 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.272283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.272373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.272579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.272855 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.272945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.273160 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.273461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.273554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.273875 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.274023 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.274222 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.275213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.275316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.275391 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.275478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.275560 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.275560 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.275749 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.276176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.276423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.276723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.276816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.277022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 16:14:40.277206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.277869 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.277971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.278057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.278057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.278194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.278281 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.279668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.279803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.279895 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.279994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280174 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280259 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280526 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.280971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.281062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.281146 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.281295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.281405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.281616 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.281720 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.281942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.282044 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.283450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.283590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.283590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.283733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.283807 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.283877 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.283947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284127 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284392 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284760 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.284953 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.285166 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.285322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.285587 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.285688 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.285899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.285991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.286221 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.286335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.286593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.286684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.286921 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.287024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.287236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.287342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.287548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.287638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.287862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.287953 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.288201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.288300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.288532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.288630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.288823 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.288909 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.289144 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.289230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.289460 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.289548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.289773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.289872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.290077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.290178 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.290428 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.290520 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.290705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.290809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.291011 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.291102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.291316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.291413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.291636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.291734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.291947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.292037 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.292252 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.292349 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.292582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.292681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.292886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.292977 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.293195 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.293286 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.293501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.293600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.293802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.293899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.294111 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.294201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.294435 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.294548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.294743 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.294836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.295063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.295160 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.295369 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.295469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.295674 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.295774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.295994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.296085 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.296295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.296471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.296646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.296803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.296961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.297054 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.297268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.297359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.297576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.297669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.297884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.297973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.298192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.298284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.298519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.298622 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.298830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.298931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.299163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.299268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.299486 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.299584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.299789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.299885 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.300127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.300218 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.300478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.300576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.300809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.301067 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.301174 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.301376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.301468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.301686 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.301777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.301992 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.302091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.302297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.302476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.302625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.302716 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.302934 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.303026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.303237 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.303326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.303539 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.303630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.303840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.303931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.304149 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.304239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.304450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.304560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.304780 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.304878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.305086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.305177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.305392 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.305492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.305713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.305943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.306038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.306131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.306326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.306576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.306671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.306810 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.306963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.307158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.307289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308256 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308494 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308587 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308815 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.308892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.309129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.309231 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.309370 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.309682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.309770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.309996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.310095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.310313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.310459 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.310654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.310743 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.310973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.314427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.314595 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.314679 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.314761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.314840 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.314918 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.314997 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315078 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315220 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315365 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315521 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315592 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315885 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.315970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316049 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316189 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316257 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316572 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316642 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316712 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316797 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.316954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317025 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317180 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317259 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317339 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317418 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317578 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317649 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317734 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317813 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.317973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.318168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.318277 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.318508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.318613 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.318805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.318901 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.319124 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.319219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.319461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.319558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.319770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.319872 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.320082 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.320177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.320405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.320518 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.321394 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.321532 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.321611 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.321698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.321787 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.321866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.321937 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.322018 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.322090 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.322166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.322245 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.322318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.322597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.322959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.323052 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.323126 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.323305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.323423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.323629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.323749 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.323943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.324127 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.324309 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.324403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.324561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.324651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.325147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.325248 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.325321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.325399 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.325486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.325558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.326145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.326232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.326312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.326446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.326535 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.326615 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327431 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327587 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.327808 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.329457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.329566 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.329641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.329712 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.329790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.329869 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.329940 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330234 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330311 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330860 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.330932 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.331010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.331081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.331549 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.331644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.331644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.331790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.332646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.332738 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.332850 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.332942 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333046 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333263 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333810 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.333903 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.334499 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.334594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.334679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.334752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.334830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.334901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.334971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.335041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.335371 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.335473 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.335547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.335627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.335868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.336158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.336307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.336515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.336623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.336816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.336907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.337089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.337181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.337352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.337442 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.337699 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.337828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.338056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.338159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.338342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.338465 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.338658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.338751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.338939 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.339040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.339213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.339309 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.339598 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.339699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.339790 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340002 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.340984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.341167 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.341272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.341695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.341805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.341880 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.341950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.342192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.342293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.342565 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.342672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.342872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.342989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.343175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.343266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.343435 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.343525 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344143 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344225 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344366 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344444 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.344931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.345063 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.345317 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.345410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.345592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.345696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.345870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.345969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.346208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.346336 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.346757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.346860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.346937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.347008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.347312 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.347413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.347497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.347741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.347907 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.348130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.348271 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.348483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.348597 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.348799 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.348899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.349079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.349170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.349348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.349453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.349728 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.349827 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.349919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.350143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.350247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.350503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.350599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.350784 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.350876 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.351025 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.351128 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.351325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.351417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.351849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.351951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.352032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.352187 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.352269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.352341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.352627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.352779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.352926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.353081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.353228 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.353382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.353530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.353675 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.353969 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.354303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.354609 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.354770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.354925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.355093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.355250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.355405 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.355552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.355697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.355849 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.355995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.356156 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.356303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.356457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.356605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.356779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.357012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.357188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.357188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.357474 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.357623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.357769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.357922 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.358077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.358223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.358368 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.358594 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.358750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.358910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.359064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.359230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.359376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.359530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.359677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.359926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.360087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.360235 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.360381 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.360527 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.360674 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.360829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.360975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.361140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.361287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.361441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.361601 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.361773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.361773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.362258 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.362518 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.362882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.363053 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.369060 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.369246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.369413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.369582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.369734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.369953 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.370189 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.370353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.370527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.370527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.370874 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.371042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.371199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.371348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.371501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.371501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.371819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.372226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.372386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.372386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.372665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.372811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.372973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.373127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.373277 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.373432 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.373579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.373734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.373891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.373891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.374191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.374344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.374517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.374677 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.374677 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.374978 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.375138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.375298 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.375455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.375615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.375762 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.375929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.376083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.376229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.376374 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.382636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.383631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.383825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.383825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.384139 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.384315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.384464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.384619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.384787 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.384944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.385092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.385262 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.385417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.385563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.385708 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.385853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.386006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.386169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.386316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.386505 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.386670 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.386836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.386993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.387307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.387464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.387612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.387759 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.387912 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.388074 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.388229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.388375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.388375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.388652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.388797 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.388962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.389121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.389272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.389421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.389572 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.389719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.389873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.390019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.390184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.390331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.390506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.390666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.390820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.390977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.391122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.391268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.391413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.391568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.391714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.391863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.392009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.392173 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.392773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.392939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.393087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.393247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.393402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.393550 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.393695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.393879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.394032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.394032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.394310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.394509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.394673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.394828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.394984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.395146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.395306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.395468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.395623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.395785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.395932 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.396078 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.396238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.396387 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.396534 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.396688 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.396839 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.396992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.397170 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.397477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.397633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.397780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.397925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.398070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.398230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.398411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.398566 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.398712 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.398857 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.399003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.399165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.399313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.399471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.399618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.399773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.399930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.400084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.400232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.400377 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.400532 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.400690 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.401208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.401366 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.401514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.401679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.401826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.401971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.402134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.402289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.402949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.403120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.403269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.403422 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.403595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.403742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.403900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.404051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.404226 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.404389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.404550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.404698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.404698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.404984 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.405142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.405299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.405299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.405586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.405586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.405865 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.406011 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.406176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.406323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.406559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.406717 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.406717 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.407000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.407160 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.407458 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.407613 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.407759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.407759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.408057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.408217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.408372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.408527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.408673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.408825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.409001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.409254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.409406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.409616 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.409778 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.409934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.410092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.410246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.410420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.410591 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.410746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.410900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.411060 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.411216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.411372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.411520 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.411810 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.411991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.412144 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.412301 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.412458 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.412628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.413179 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.413439 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.413593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.413740 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.413900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.414059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.414223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.414369 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.414567 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.414722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.414879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.415040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.415199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.415347 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.415502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.415655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.415802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.415802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.416089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.416243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.416400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.416555 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.416709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.416866 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.417029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.417176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.417329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.417616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.417783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.417948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.418105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.418267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.418482 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.418654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.418809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.419021 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.419171 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.419326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.419482 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.419628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.419781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.419940 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.420088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.420233 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.420233 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.420528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.420685 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.420831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.420988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.421132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.421284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.421431 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.421597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.421751 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.421897 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.422042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.422187 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.422331 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.422524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.422683 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.423219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.423549 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.423718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.423868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.424028 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.424179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.424337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.424484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.424629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.424795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.424943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.425171 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.425336 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.425484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.425656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.425822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.425978 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.426132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.426278 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.426441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.426592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.426592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.426967 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.427114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.427261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.427413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.427720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.427899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.428055 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.428203 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.428437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.428593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.428752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.428907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.429061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.429208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.429354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.429516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.429712 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.429880 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.430029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.430176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.430321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.430519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.430684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.430840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.430988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.431142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.431289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.431444 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.431598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.431745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.431908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.431908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.432187 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.432347 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.432502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.432648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.432800 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.433054 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.434255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.434455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.434455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.434830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.435000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.435158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.435315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.435481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.435629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.435775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.435929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.436084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.436245 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.436403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.436556 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.436702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.436854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.437019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.437188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.437353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.437512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.437660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.437957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.438117 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.438352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.438582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.438732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.438889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.439037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.439193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.439365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.439515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.439670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.439825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.439973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.440133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.440356 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.440514 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.440663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.440907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.441073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.441237 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.441407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.441556 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.441703 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.441860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.442021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.442177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.442326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.442512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.442672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.442828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.442828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.443217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.443473 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.443635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.443798 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.443961 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.444462 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.444462 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.444755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.444912 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.445069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.445069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.445373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.445373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.445672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.445829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.445978 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.446248 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.446608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.446786 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.446936 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.447083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.447230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.447391 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.447563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.447719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.447886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.447886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.448321 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.448479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.448628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.448790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.448945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.449099 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.449257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.449404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.449562 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.449710 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.449857 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.450015 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.450178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.450332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.450509 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.450668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.450823 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.450981 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.451141 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.451297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.451453 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.451609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.451817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.451976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.452148 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.452305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.452452 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.452599 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.452746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.452905 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.453063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.453229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.453460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.453676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.453828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.453989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.454140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.454625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.454841 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.455001 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.455162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.455319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.455475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.455623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.455770 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.455917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.456076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.456225 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.456598 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.456781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.456933 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.457088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.457249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.457463 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.457625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.457782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.457929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.458074 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.458409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.458566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.458713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.458870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.459046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.459203 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.459351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.459505 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.459659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.459807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.459954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.460123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.460278 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.460427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.460575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.460729 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.460899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.460899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.461316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.461489 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.461646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.461795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.461941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.461941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462110 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462727 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.462896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.463024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.463155 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.463272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.463388 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.463594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.463817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.463933 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.464059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.464176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.464285 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.464419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.464887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.464998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465362 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465362 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465709 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.465936 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466167 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466670 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466794 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.466904 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467467 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.467929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.468047 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.468157 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.468414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.468539 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.468658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.468825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.468938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469168 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469302 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469545 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.469922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470043 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470543 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.470898 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471239 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471357 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.471702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.472753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.474058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.475443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.476253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.477846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.478948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.479795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.480651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.480651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.480651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.480651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.480651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 16:14:40.480651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 16:14:40.481698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_db.sqlalchemy.engines [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:40.501272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-cc39ed49-c860-48f8-836a-23950884982b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:40.648093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.context [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),539e9b60-8ce1-4f2b-9153-f282c518691a(cell1) {{(pid=116167) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 16:14:40.652697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:40.654256 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:40.655097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:40.657014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:40.667552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.context [None req-cc39ed49-c860-48f8-836a-23950884982b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),539e9b60-8ce1-4f2b-9153-f282c518691a(cell1) {{(pid=116168) load_cells /opt/stack/nova/nova/context.py:464}} Nov 16 16:14:40.667773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_db.sqlalchemy.engines [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:40.668402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_db.sqlalchemy.engines [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:40.672118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cc39ed49-c860-48f8-836a-23950884982b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:40.673704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cc39ed49-c860-48f8-836a-23950884982b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:40.674579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cc39ed49-c860-48f8-836a-23950884982b None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:14:40.677019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cc39ed49-c860-48f8-836a-23950884982b None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:14:40.687388 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-cc39ed49-c860-48f8-836a-23950884982b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:40.690164 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-cc39ed49-c860-48f8-836a-23950884982b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:40.830232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_db.sqlalchemy.engines [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:40.853847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_db.sqlalchemy.engines [None req-cc39ed49-c860-48f8-836a-23950884982b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 16:14:41.151708 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: WARNING keystonemiddleware.auth_token [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:14:41.158243 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: WARNING keystonemiddleware.auth_token [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:14:41.181271 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-cc39ed49-c860-48f8-836a-23950884982b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:14:41.187910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-cc39ed49-c860-48f8-836a-23950884982b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:14:41.513437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: WARNING keystonemiddleware.auth_token [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:14:41.519715 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: WARNING keystonemiddleware.auth_token [None req-c9161479-d99e-4b38-bb06-123445d9c041 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:14:41.525300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5627ee75b9c0 pid: 116167 (default app) Nov 16 16:14:41.553764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-cc39ed49-c860-48f8-836a-23950884982b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 16 16:14:41.559480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: WARNING keystonemiddleware.auth_token [None req-cc39ed49-c860-48f8-836a-23950884982b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 16 16:14:41.564948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5627ee75b9c0 pid: 116168 (default app) Nov 16 16:15:16.386868 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-05496cba-ac28-4f93-b23e-dc2a963bb208 tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] Action: 'create', calling method: .version_select at 0x7f3ec95cbd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-869682627", "metadata": {"Type": "work"}}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:16.447185 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8feb28f5-959f-4fa8-8163-fd6c32a9cdee tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Action: 'create', calling method: .version_select at 0x7f3ec95ccd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-962874811", "metadata": {"Type": "work"}}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:16.450661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8feb28f5-959f-4fa8-8163-fd6c32a9cdee tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:16.451972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8feb28f5-959f-4fa8-8163-fd6c32a9cdee tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.339192 Nov 16 16:15:16.452692 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Nov 16 16:15:15 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:15:16.782664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1106992189", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "87532d28-954d-488e-beef-2ed2275c6575"}]}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:17.771683 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] validate_networks() for [('87532d28-954d-488e-beef-2ed2275c6575', None, None, None, None, None)] {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:15:18.307064 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-05496cba-ac28-4f93-b23e-dc2a963bb208 tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.071689 Nov 16 16:15:18.315884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 1/2] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Nov 16 16:15:15 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3082 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 16 16:15:18.325389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f95b50b1-8121-4a23-a263-0b95649a6cd3 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Action: 'create', calling method: .version_select at 0x7f3ec94e08b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1803670880", "metadata": {"Type": "work"}}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:18.327158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f95b50b1-8121-4a23-a263-0b95649a6cd3 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:18.328514 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f95b50b1-8121-4a23-a263-0b95649a6cd3 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011191 Nov 16 16:15:18.334070 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Nov 16 16:15:18 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:15:18.567687 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1736449574", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "aa7080f4-de34-4d19-9887-d746d1afba4c"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:18.728507 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] validate_networks() for [('aa7080f4-de34-4d19-9887-d746d1afba4c', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:15:19.376076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:15:19.377078 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:15:19.377990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:15:19.379471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:15:19.379948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:15:19.423962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:19.424507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:19.425396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:19.427798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:19.478524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:15:19.489552 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for user 99d58fe781aa40b2abf368dcc69b1a53 and project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:15:19.516816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:15:19.520520 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:15:19.648990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-13cf32bf-6d95-43fb-b6cd-cf814e616b2c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.189940 Nov 16 16:15:19.651465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 2/4] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:15:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 3198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:15:19.666146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b4a930bd-bc45-4996-b9e6-b399af3ee8ce tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] Calling method '.version_select at 0x7f3ec93cc670>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:19.764072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b4a930bd-bc45-4996-b9e6-b399af3ee8ce tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520" status: 200 len: 353 microversion: 2.1 time: 0.110551 Nov 16 16:15:19.764982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 3/5] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:19 2021] GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:19.774002 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-35f7dad3-2e2b-4863-ada8-9a14b416aec0 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Action: 'create', calling method: .version_select at 0x7f3ec8b6e3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1772378384", "metadata": {"Type": "work"}}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:19.785687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-35f7dad3-2e2b-4863-ada8-9a14b416aec0 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:19.803847 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-35f7dad3-2e2b-4863-ada8-9a14b416aec0 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.037271 Nov 16 16:15:19.804433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 4/6] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Nov 16 16:15:19 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:15:19.821416 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-44e1173b-dbfa-4b47-b52c-331870d111b7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:19.826967 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-44e1173b-dbfa-4b47-b52c-331870d111b7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:20.119816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-44e1173b-dbfa-4b47-b52c-331870d111b7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:20.148397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-44e1173b-dbfa-4b47-b52c-331870d111b7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1218 microversion: 2.1 time: 0.338783 Nov 16 16:15:20.158475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 5/7] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:19 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1218 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:20.158475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-58ce5824-5534-4390-9561-c7e57e2554a4 tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] Calling method '.version_select at 0x7f3ec82e40d0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:20.278798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-58ce5824-5534-4390-9561-c7e57e2554a4 tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520" status: 200 len: 353 microversion: 2.1 time: 0.124909 Nov 16 16:15:20.279810 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 6/8] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:20 2021] GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520 => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:20.286579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6620c44b-d804-4b36-b576-fb10056f4198 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Calling method '.version_select at 0x7f3ec82f1280>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:20.355285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-6620c44b-d804-4b36-b576-fb10056f4198 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] HTTP exception thrown: Volume tempest-invalid-1378408088 could not be found. Nov 16 16:15:20.356300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6620c44b-d804-4b36-b576-fb10056f4198 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Returning 404 to user: Volume tempest-invalid-1378408088 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:20.357348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6620c44b-d804-4b36-b576-fb10056f4198 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1378408088" status: 404 len: 99 microversion: 2.1 time: 0.076528 Nov 16 16:15:20.358122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 7/9] 10.222.0.61 () {58 vars in 1217 bytes} [Tue Nov 16 16:15:20 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1378408088 => generated 99 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 16 16:15:20.377106 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-05b3fc67-ee2e-46f4-9c86-562e61f6a0ab tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] Calling method '.version_select at 0x7f3ec82e4040>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:20.526501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-05b3fc67-ee2e-46f4-9c86-562e61f6a0ab tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520" status: 202 len: 0 microversion: 2.1 time: 0.167161 Nov 16 16:15:20.530836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 8/10] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Nov 16 16:15:20 2021] DELETE /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:15:20.541584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b297830d-e18a-48e3-a014-d3f875302cd0 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012552 Nov 16 16:15:20.548512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 9/11] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Nov 16 16:15:20 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 16:15:20.570565 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c667ae9a-ee38-4cd6-8e70-4dfeb7526ea3 tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] Calling method '.version_select at 0x7f3ec82e40d0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:20.697689 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c667ae9a-ee38-4cd6-8e70-4dfeb7526ea3 tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520" status: 200 len: 352 microversion: 2.1 time: 0.139851 Nov 16 16:15:20.698322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 10/12] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:20 2021] GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520 => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:20.703178 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-99684b60-d155-48e8-a29e-35bd12962ad7 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003392 Nov 16 16:15:20.709210 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 11/13] 10.222.0.61 () {58 vars in 1136 bytes} [Tue Nov 16 16:15:20 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 16 16:15:20.729723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6d812ed2-dcea-4267-8e42-2f69c625379a tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Calling method '.version_select at 0x7f3ec82f15e0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:20.753530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:15:20.754353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:15:20.762566 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:15:20.764925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:15:20.765707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:15:20.789899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:20.790599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:20.791651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:20.792739 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:20.850651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-6d812ed2-dcea-4267-8e42-2f69c625379a tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] HTTP exception thrown: Volume d7b50c69-aa03-4be2-a9ff-137dacf82cda could not be found. Nov 16 16:15:20.851623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6d812ed2-dcea-4267-8e42-2f69c625379a tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Returning 404 to user: Volume d7b50c69-aa03-4be2-a9ff-137dacf82cda could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:20.852968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6d812ed2-dcea-4267-8e42-2f69c625379a tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/d7b50c69-aa03-4be2-a9ff-137dacf82cda" status: 404 len: 109 microversion: 2.1 time: 0.142114 Nov 16 16:15:20.860102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 12/14] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Nov 16 16:15:20 2021] DELETE /compute/v2.1/os-volumes/d7b50c69-aa03-4be2-a9ff-137dacf82cda => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:15:20.869605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-79788558-aadc-40dc-8b23-d3c62dace944 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Calling method '.version_select at 0x7f3ec82d2ee0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:20.880871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Getting quotas for project 990dd2b2c59e48e595895701e1347ea5. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:15:20.903756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Getting quotas for user d24fd836e181415e976fbd3d41d7dd14 and project 990dd2b2c59e48e595895701e1347ea5. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:15:20.919161 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:15:20.923487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:15:20.924123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-79788558-aadc-40dc-8b23-d3c62dace944 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] HTTP exception thrown: Volume 65f306ab-b52e-4d2a-b165-ae890783dadb could not be found. Nov 16 16:15:20.924840 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-79788558-aadc-40dc-8b23-d3c62dace944 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] Returning 404 to user: Volume 65f306ab-b52e-4d2a-b165-ae890783dadb could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:20.925633 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-79788558-aadc-40dc-8b23-d3c62dace944 tempest-VolumesNegativeTest-35054979 tempest-VolumesNegativeTest-35054979-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/65f306ab-b52e-4d2a-b165-ae890783dadb" status: 404 len: 109 microversion: 2.1 time: 0.064288 Nov 16 16:15:20.926814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 13/15] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:20 2021] GET /compute/v2.1/os-volumes/65f306ab-b52e-4d2a-b165-ae890783dadb => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:15:21.071582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6fd8a249-4d60-4fd7-9a31-ed7cd64e54bf tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.735928 Nov 16 16:15:21.073103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 3/16] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:15:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:15:21.083619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-df87ee98-3067-4754-aca4-7bd895d92758 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:21.084241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-df87ee98-3067-4754-aca4-7bd895d92758 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:21.166295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9b6d124a-8585-46d2-becf-ceb24e8f7cdf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:21.167271 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9b6d124a-8585-46d2-becf-ceb24e8f7cdf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:21.269703 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-df87ee98-3067-4754-aca4-7bd895d92758 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:21.283449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-df87ee98-3067-4754-aca4-7bd895d92758 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1215 microversion: 2.1 time: 0.204116 Nov 16 16:15:21.290454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 14/17] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:21 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:21.391808 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9b6d124a-8585-46d2-becf-ceb24e8f7cdf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:21.446938 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9b6d124a-8585-46d2-becf-ceb24e8f7cdf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1218 microversion: 2.1 time: 0.285271 Nov 16 16:15:21.458690 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 4/18] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:21 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1218 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:21.713059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-70cb48ca-54dc-4387-9617-667615d1b4ed tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] Calling method '.version_select at 0x7f3ec8340a60>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:21.776707 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-70cb48ca-54dc-4387-9617-667615d1b4ed tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] HTTP exception thrown: Volume 2eeaf9a6-46c6-44f8-88ec-b2bf91678520 could not be found. Nov 16 16:15:21.777433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-70cb48ca-54dc-4387-9617-667615d1b4ed tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] Returning 404 to user: Volume 2eeaf9a6-46c6-44f8-88ec-b2bf91678520 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:15:21.778444 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-70cb48ca-54dc-4387-9617-667615d1b4ed tempest-VolumesGetTestJSON-1203979030 tempest-VolumesGetTestJSON-1203979030-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520" status: 404 len: 109 microversion: 2.1 time: 0.070442 Nov 16 16:15:21.779101 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 15/19] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:21 2021] GET /compute/v2.1/os-volumes/2eeaf9a6-46c6-44f8-88ec-b2bf91678520 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:15:22.304166 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-11997964-4cfc-494b-b978-4ef9551e11cc tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:22.304816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-11997964-4cfc-494b-b978-4ef9551e11cc tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:22.466307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:22.466963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:22.480863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:22.481347 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:22.482146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:22.482611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:22.673908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-11997964-4cfc-494b-b978-4ef9551e11cc tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:22.705846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-11997964-4cfc-494b-b978-4ef9551e11cc tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1215 microversion: 2.1 time: 0.405315 Nov 16 16:15:22.706478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 5/20] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:22 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1215 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:22.786989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:22.849507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8632f90e-4552-4778-951f-55f30ed52dab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1270 microversion: 2.1 time: 0.387434 Nov 16 16:15:22.854672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 16/21] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:22 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1270 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:23.724030 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:23.724561 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:23.756785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:23.760390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:23.765053 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:23.771571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:23.869186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:23.869796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:23.884450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:23.885888 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:23.889621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:23.890289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:24.109936 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:24.126403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a30c67cb-b0cf-4922-b35f-b3fc35d907ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1276 microversion: 2.1 time: 0.260729 Nov 16 16:15:24.127302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 17/22] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:23 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1276 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:24.157800 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:24.177408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-72757221-0d0c-40e6-96bd-9aa382e719f0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1211 microversion: 2.1 time: 0.458265 Nov 16 16:15:24.178023 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 6/23] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:23 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1211 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:25.145319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:25.147028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:25.161835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:25.163461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:25.167080 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:25.169147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:25.196866 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:25.198491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:25.216744 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:25.221238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:25.225070 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:25.226616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:25.463418 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:25.480727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0376e639-6c60-4907-ad3e-f3d8cc097055 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1276 microversion: 2.1 time: 0.337813 Nov 16 16:15:25.497701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 18/24] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:25 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1276 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:25.594114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:25.612623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-62c5415f-5972-41e0-bffc-62a1279dc75d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1273 microversion: 2.1 time: 0.418861 Nov 16 16:15:25.617400 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 7/25] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:25 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1273 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:26.502555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:26.503508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:26.518151 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:26.521238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:26.541837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:26.545616 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:26.635552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:26.636617 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:26.645441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:26.645911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:26.650648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:26.652017 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:26.823677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:26.841507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b14ed265-142f-4019-b381-fd719b33d00a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1276 microversion: 2.1 time: 0.344558 Nov 16 16:15:26.842082 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 19/26] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:26 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1276 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:26.936757 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:26.948824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-03eea835-08bd-4a90-bd25-262bfd2c48dd tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1273 microversion: 2.1 time: 0.317185 Nov 16 16:15:26.950106 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 8/27] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:26 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:27.859650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:27.860265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:27.869534 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:27.869995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:27.873008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:27.873672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:27.973364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:27.974880 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:27.989800 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:27.999991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:28.001078 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:28.001693 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:29.686313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:29.707024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8cad5172-ba62-4c48-85b1-7f7ab6c06016 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 1.843817 Nov 16 16:15:29.707768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 20/28] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:27 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:29.798553 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:29.813809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2f477cd2-a3aa-402f-bfed-43aafee0b2b3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 1.848408 Nov 16 16:15:29.823768 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 9/29] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:27 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:31.131031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1604990024", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a692926-56f3-4259-b808-4829f7b9d0fc"}]}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:31.234353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4e90230f-f828-47b0-b2bd-33b2ccecc448 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'create', calling method: .version_select at 0x7f3ec9dad1f0>, body: {"keypair": {"name": "tempest-keypair-921566543"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:31.262023 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] validate_networks() for [('7a692926-56f3-4259-b808-4829f7b9d0fc', None, None, None, None, None)] {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:15:31.309103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-4e90230f-f828-47b0-b2bd-33b2ccecc448 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:15:31.322835 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-4e90230f-f828-47b0-b2bd-33b2ccecc448 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for user b54ac91a208046b0ad1ab26903a289a7 and project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:15:32.073106 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-4e90230f-f828-47b0-b2bd-33b2ccecc448 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:15:32.088971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-4e90230f-f828-47b0-b2bd-33b2ccecc448 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for user b54ac91a208046b0ad1ab26903a289a7 and project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:15:32.120232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4e90230f-f828-47b0-b2bd-33b2ccecc448 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.405178 Nov 16 16:15:32.121372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 10/30] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Nov 16 16:15:30 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:32.137968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:32.138650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:32.149651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:32.150525 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:32.151460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:32.152168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:32.562888 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:15:32.564022 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:15:32.564682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:15:32.565536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:15:32.566186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:15:32.612936 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:32.616213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:32.617352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:32.623721 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:32.730130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Getting quotas for project 083b4d0792f3466b9c3e1fbc219e5b01. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:15:32.756663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Getting quotas for user 3a93b78bf18b42bc929d716d21793438 and project 083b4d0792f3466b9c3e1fbc219e5b01. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:15:32.764367 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:32.776722 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f954d36-c0e4-4516-bacf-3915786ecfa4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.653400 Nov 16 16:15:32.782891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 11/31] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:32 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:32.794785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:32.796750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:32.805966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:32.806689 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:32.807642 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:32.808203 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:32.823069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:15:32.834073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:15:33.098472 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f8a4b361-53bb-4401-9dd4-26281c3c5cec tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.720182 Nov 16 16:15:33.099152 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 21/32] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:15:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:15:33.153463 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-01788505-2325-45e6-b285-cc06af6ea31c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:33.157963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-01788505-2325-45e6-b285-cc06af6ea31c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:33.286234 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:33.302311 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-789d5800-1d91-4503-a066-0e17e7c584b4 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.510824 Nov 16 16:15:33.303830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 12/33] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:32 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:33.447711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-01788505-2325-45e6-b285-cc06af6ea31c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:33.472371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-01788505-2325-45e6-b285-cc06af6ea31c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1222 microversion: 2.1 time: 0.360432 Nov 16 16:15:33.477277 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 22/34] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:33 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1222 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:33.797532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:33.799071 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:33.828445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:33.829039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:33.829909 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:33.830554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:33.856175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-366558485", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a692926-56f3-4259-b808-4829f7b9d0fc"}]}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:34.001261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] validate_networks() for [('7a692926-56f3-4259-b808-4829f7b9d0fc', None, None, None, None, None)] {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:15:35.734658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:35.749330 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ea550803-a445-4c14-a201-6955e860c901 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 1.957625 Nov 16 16:15:35.766484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 13/35] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:33 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:35.771633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:35.777101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:35.805256 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:35.815136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:35.816080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:35.816588 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:36.663636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:36.674008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fe614575-2a9f-42b1-b702-a26d488dc8c6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.906014 Nov 16 16:15:36.676442 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 14/36] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:35 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:36.689564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2318a641-7f4e-4b5a-a991-e810b0f933d8 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec8221ca0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:36.696770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:15:36.697902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:15:36.698687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:15:36.699402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:15:36.700033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:15:36.738161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:36.739744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:36.741866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:36.743897 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:36.818502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Getting quotas for project 083b4d0792f3466b9c3e1fbc219e5b01. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:15:36.835843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Getting quotas for user 3a93b78bf18b42bc929d716d21793438 and project 083b4d0792f3466b9c3e1fbc219e5b01. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:15:36.880161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:15:36.887697 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2318a641-7f4e-4b5a-a991-e810b0f933d8 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/574c2b73-5ccd-4b31-a955-b6d7ccde97d8" status: 200 len: 350 microversion: 2.1 time: 0.208606 Nov 16 16:15:36.890071 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 15/37] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:36 2021] GET /compute/v2.1/os-volumes/574c2b73-5ccd-4b31-a955-b6d7ccde97d8 => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:36.919486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:15:37.111856 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-06cf17d0-0328-4833-abf4-05cb79086be6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.260529 Nov 16 16:15:37.126035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 23/38] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:15:33 2021] POST /compute/v2.1/servers => generated 383 bytes in 3268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:15:37.126035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:37.126035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:37.134448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:37.134868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:37.136558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:37.137238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:37.656940 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-48179f60-3bb9-4821-8f77-213be2369a1f req-cb34b4af-a371-4ee9-a2a1-34d77cacaeba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404a11e5-c791-46cd-b455-ef6eca512695", "tag": "47508073-20f8-411c-b5ec-1fee3ead99b0"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:37.660361 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:37.660361 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:15:37.727857 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-48179f60-3bb9-4821-8f77-213be2369a1f req-cb34b4af-a371-4ee9-a2a1-34d77cacaeba service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:37.728740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-48179f60-3bb9-4821-8f77-213be2369a1f req-cb34b4af-a371-4ee9-a2a1-34d77cacaeba service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:37.825887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-48179f60-3bb9-4821-8f77-213be2369a1f req-cb34b4af-a371-4ee9-a2a1-34d77cacaeba service nova] Creating event network-changed:47508073-20f8-411c-b5ec-1fee3ead99b0 for instance 404a11e5-c791-46cd-b455-ef6eca512695 on hv-cinder-78776 Nov 16 16:15:37.830687 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-48179f60-3bb9-4821-8f77-213be2369a1f req-cb34b4af-a371-4ee9-a2a1-34d77cacaeba service nova] Acquired lock "compute-rpcapi-router" {{(pid=116168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 16 16:15:37.836098 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee0d0195-c43a-4cea-b94a-dd0ab83f1bad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:37.842863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee0d0195-c43a-4cea-b94a-dd0ab83f1bad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:37.847747 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee0d0195-c43a-4cea-b94a-dd0ab83f1bad None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:37.849829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee0d0195-c43a-4cea-b94a-dd0ab83f1bad None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:37.901459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.compute.rpcapi [None req-ee0d0195-c43a-4cea-b94a-dd0ab83f1bad None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 16:15:37.911790 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee0d0195-c43a-4cea-b94a-dd0ab83f1bad None None] Releasing lock "compute-rpcapi-router" {{(pid=116168) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 16 16:15:38.029877 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ee0d0195-c43a-4cea-b94a-dd0ab83f1bad None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.137913 Nov 16 16:15:38.030492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 16/39] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:38.037613 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ea36a16d-20a0-4726-89f8-0569cbdd822b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:38.038407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ea36a16d-20a0-4726-89f8-0569cbdd822b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:38.395748 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea36a16d-20a0-4726-89f8-0569cbdd822b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:38.405745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ea36a16d-20a0-4726-89f8-0569cbdd822b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1221 microversion: 2.1 time: 0.373823 Nov 16 16:15:38.415764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 17/40] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:38 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1221 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:38.443359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:38.457167 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:38.481115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:38.483453 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:38.487547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:38.490533 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:38.807942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:38.821788 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f6115385-a616-4e07-b098-ca042009bce2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 1.698745 Nov 16 16:15:38.822919 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 24/41] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:37 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:39.180236 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ab833889-27ae-4d04-910c-238d26069a3f tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec8255ee0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:39.276082 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ab833889-27ae-4d04-910c-238d26069a3f tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/87c1ba22-8ec4-4b9e-b6d6-ed032ebf7000" status: 200 len: 351 microversion: 2.1 time: 0.101898 Nov 16 16:15:39.277563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 25/42] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:39 2021] GET /compute/v2.1/os-volumes/87c1ba22-8ec4-4b9e-b6d6-ed032ebf7000 => generated 351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:15:39.426816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:39.427449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:39.438900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:39.439412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:39.441741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:39.443214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:39.522819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:39.538955 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7b53ec1b-b4be-4033-914d-246757043a61 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 1.121918 Nov 16 16:15:39.540159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 18/43] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:38 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:39.634501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:39.649130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-67e8ede9-100c-4e2c-b9e9-070884f46139 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1273 microversion: 2.1 time: 0.228441 Nov 16 16:15:39.668531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 26/44] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:39 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1273 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:39.841903 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:39.842547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:39.849540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:39.850238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:39.851046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:39.851741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:39.947325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-152354549", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6c5d706-4c9c-40fa-8a45-39a54b7b888c"}], "security_groups": [{"name": "tempest-securitygroup--930459812"}], "key_name": "tempest-keypair-921566543", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:40.596674 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] validate_networks() for [('a6c5d706-4c9c-40fa-8a45-39a54b7b888c', None, None, None, None, None)] {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:15:40.812589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:40.823563 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1dc7cda4-37c2-417e-877b-4c1e2a01784f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.985693 Nov 16 16:15:40.824221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 19/45] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:39 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:40.858771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-8c5c088c-29dd-4527-a76f-fc462c599a28 req-4d0dd596-3ed5-4762-b1e5-fe84596a5ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc4a1e6e-5d38-4c3e-8381-112022eb6207", "tag": "975ed373-f034-4688-b3e3-efe810e76c1c"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:40.865516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:40.865516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:15:40.868873 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8c5c088c-29dd-4527-a76f-fc462c599a28 req-4d0dd596-3ed5-4762-b1e5-fe84596a5ebb service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:40.869326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8c5c088c-29dd-4527-a76f-fc462c599a28 req-4d0dd596-3ed5-4762-b1e5-fe84596a5ebb service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:40.881590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-8c5c088c-29dd-4527-a76f-fc462c599a28 req-4d0dd596-3ed5-4762-b1e5-fe84596a5ebb service nova] Creating event network-changed:975ed373-f034-4688-b3e3-efe810e76c1c for instance cc4a1e6e-5d38-4c3e-8381-112022eb6207 on hv-cinder-78776 Nov 16 16:15:40.886545 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-8c5c088c-29dd-4527-a76f-fc462c599a28 req-4d0dd596-3ed5-4762-b1e5-fe84596a5ebb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051547 Nov 16 16:15:40.887496 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 20/46] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:40.892832 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:40.893754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:40.900764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:40.901447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:40.902517 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:40.903114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:41.176581 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:41.184703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a99e3f2b-4a93-4880-bea1-2ca2a36c7d92 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.295746 Nov 16 16:15:41.194143 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 21/47] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:40 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:41.208002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:41.208002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:41.215240 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:41.215785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:41.216897 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:41.217525 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:41.319930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:41.329662 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d7cf2b81-32e9-46bf-92dc-9f348a7c7ad8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1273 microversion: 2.1 time: 0.126413 Nov 16 16:15:41.331299 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 22/48] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:41 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:41.336059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d808022b-488c-4562-b803-31a55b7a202b tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec81be550>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:41.431343 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d808022b-488c-4562-b803-31a55b7a202b tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/24f9f164-af2a-4a41-b626-bc56c39107d7" status: 200 len: 351 microversion: 2.1 time: 0.098711 Nov 16 16:15:41.432554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 23/49] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:15:41 2021] GET /compute/v2.1/os-volumes/24f9f164-af2a-4a41-b626-bc56c39107d7 => generated 351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:41.445348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a75aad33-1bc7-4950-9b96-5f3054d03811 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec81be700>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:41.579656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a75aad33-1bc7-4950-9b96-5f3054d03811 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.139405 Nov 16 16:15:41.580574 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 24/50] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Nov 16 16:15:41 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:41.596577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-da6bf0d8-330e-474c-8010-788c9080e3e9 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec81e6550>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:41.744861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-da6bf0d8-330e-474c-8010-788c9080e3e9 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.153093 Nov 16 16:15:41.753179 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 25/51] 10.222.0.61 () {58 vars in 1148 bytes} [Tue Nov 16 16:15:41 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:41.758302 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f24128e-cf44-40fb-b2f4-d5b9bc64a69d tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec8249430>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:41.763999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:15:41.764572 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:15:41.765017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:15:41.765528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:15:41.766120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:15:41.788465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:41.793142 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:41.794130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:41.794722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:41.852790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for project 64e41658de1c433d88953df323d876ba. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:15:41.857775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for user b54ac91a208046b0ad1ab26903a289a7 and project 64e41658de1c433d88953df323d876ba. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:15:41.872468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:15:41.875135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:15:41.955137 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f24128e-cf44-40fb-b2f4-d5b9bc64a69d tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.200505 Nov 16 16:15:41.956279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 26/52] 10.222.0.61 () {58 vars in 1133 bytes} [Tue Nov 16 16:15:41 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:41.961513 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:41.962278 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:41.981112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-27605d40-109a-4900-8891-a22d90c9b982 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.038173 Nov 16 16:15:41.982296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 27/53] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:15:39 2021] POST /compute/v2.1/servers => generated 401 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:15:41.982510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:41.983302 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:41.984473 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:41.984915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:41.993217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-71452488-186e-4d45-aee0-ff5be70af5d3 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec82483a0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:42.378915 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-71452488-186e-4d45-aee0-ff5be70af5d3 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.395107 Nov 16 16:15:42.380614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 28/54] 10.222.0.61 () {58 vars in 1166 bytes} [Tue Nov 16 16:15:41 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:42.390396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-607eeef0-05ae-49a2-9954-b69c9c107d9c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:42.392937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-607eeef0-05ae-49a2-9954-b69c9c107d9c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:42.498030 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-607eeef0-05ae-49a2-9954-b69c9c107d9c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:42.529907 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-607eeef0-05ae-49a2-9954-b69c9c107d9c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1236 microversion: 2.1 time: 0.147914 Nov 16 16:15:42.530548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 29/55] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:42 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1236 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:42.551911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:42.552546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:42.572894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:42.574527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:42.576056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:42.578068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:42.738554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:42.760941 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-472f2092-ea03-4917-9627-c2eca49e7c14 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.803406 Nov 16 16:15:42.773149 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 27/56] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:41 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:42.782301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:42.783513 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:42.795655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:42.796120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:42.796980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:42.797427 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:43.053677 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:43.070696 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3a67c9c7-a4f0-4bf2-bf79-12b1816b5c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1279 microversion: 2.1 time: 0.287047 Nov 16 16:15:43.071702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 28/57] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:42 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:43.076521 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-deff121b-e04e-4599-927f-0e545211058a tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec81bee50>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:43.277363 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:43.287842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-19cb579a-9d52-4801-9a16-a6d7ccf1208e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.756193 Nov 16 16:15:43.293780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 30/58] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:42 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:43.382085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-deff121b-e04e-4599-927f-0e545211058a tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.308847 Nov 16 16:15:43.400495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-604ae4b0-16a5-4d8a-93ca-9f78b18f25b6 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec83408b0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:43.401117 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 29/59] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Nov 16 16:15:43 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:43.577614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-604ae4b0-16a5-4d8a-93ca-9f78b18f25b6 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.184664 Nov 16 16:15:43.586181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 31/60] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Nov 16 16:15:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:43.593562 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:43.594660 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:43.604872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:43.606871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:43.607984 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:43.608858 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:43.680136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-a4694fe9-8df3-4894-9d6f-a459580bfa89 req-df7990b6-6995-499e-8e8c-926fb3ffd2cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca96c22d-d0ae-48e0-9f0f-fa02d0324fec", "tag": "85446dc9-e1a3-4e4d-90db-94d908195108"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:43.682665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:43.682665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:15:43.705217 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a4694fe9-8df3-4894-9d6f-a459580bfa89 req-df7990b6-6995-499e-8e8c-926fb3ffd2cf service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:43.706506 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a4694fe9-8df3-4894-9d6f-a459580bfa89 req-df7990b6-6995-499e-8e8c-926fb3ffd2cf service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:43.726804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-a4694fe9-8df3-4894-9d6f-a459580bfa89 req-df7990b6-6995-499e-8e8c-926fb3ffd2cf service nova] Creating event network-changed:85446dc9-e1a3-4e4d-90db-94d908195108 for instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec on hv-cinder-78776 Nov 16 16:15:43.757709 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-a4694fe9-8df3-4894-9d6f-a459580bfa89 req-df7990b6-6995-499e-8e8c-926fb3ffd2cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211057 Nov 16 16:15:43.766359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 30/61] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:15:43.784147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-57b7fd94-71ed-4f2f-9923-f304b1c75cc0 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec8221ee0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:43.870429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:43.886112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-def6bb56-d712-4040-b5b7-75d7e07460c8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1296 microversion: 2.1 time: 0.297733 Nov 16 16:15:43.886750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 32/62] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:43 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1296 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:43.891193 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:43.891787 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:43.907195 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:43.907648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:43.908729 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:43.909289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:43.950636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-57b7fd94-71ed-4f2f-9923-f304b1c75cc0 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.182507 Nov 16 16:15:43.951506 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 31/63] 10.222.0.61 () {58 vars in 1187 bytes} [Tue Nov 16 16:15:43 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:43.964304 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1bfe3573-9f2b-4a0f-ae56-12dfc0412c64 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] Calling method '.version_select at 0x7f3ec822ee50>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:44.168081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1bfe3573-9f2b-4a0f-ae56-12dfc0412c64 tempest-VolumesTestJSON-467798352 tempest-VolumesTestJSON-467798352-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.208444 Nov 16 16:15:44.168657 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 32/64] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Nov 16 16:15:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:44.175191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:44.175191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:44.192819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:44.193264 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:44.194058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:44.194520 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:44.394678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:44.402927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b326a97a-4edd-48b9-8451-ed04662dc45d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.515096 Nov 16 16:15:44.403748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 33/65] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:43 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:44.408470 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:44.409391 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:44.417122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:44.417765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:44.418731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:44.419299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:44.625741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:44.639293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-33f53857-994a-405c-abfb-628449cb2b4e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.469531 Nov 16 16:15:44.640152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 33/66] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:44 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:44.669803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:44.678779 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-46e3422f-416c-4680-ac28-3d79bfec035f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.273575 Nov 16 16:15:44.679358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 34/67] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:44 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:44.908944 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:44.910039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:44.916698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:44.919046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:44.920184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:44.920809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:44.995732 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:45.004573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-444070e7-f82c-4419-b00f-5c046e572061 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1294 microversion: 2.1 time: 0.100705 Nov 16 16:15:45.005316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 34/68] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:44 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:45.422040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:45.423068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:45.441200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:45.441922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:45.442920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:45.443682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:45.641436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:45.657211 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8178a65d-4c93-4812-987f-4b6973fa4f10 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.240764 Nov 16 16:15:45.659409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 35/69] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:45 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:45.667101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:45.668349 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:45.675226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:45.675738 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:45.676539 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:45.676975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:45.695181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:45.695820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:45.710583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:45.711788 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:45.713634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:45.714281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:45.933316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:45.944674 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:45.954484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1868f821-297f-4c52-8387-3a6950ca50a6 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.263156 Nov 16 16:15:45.956121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eb66abdd-2a32-422b-b17a-1964e5ddd738 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.295717 Nov 16 16:15:45.965489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 36/70] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:45 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:45.965868 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 35/71] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:45 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:45.970278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-3c707fec-8166-44e2-9461-269de15d0cfe req-50693498-7afa-4548-99aa-b3b241a09f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c10d18-b689-4550-a354-e0b0594039b3", "tag": "d959c80e-06c3-41aa-8b1d-d2db534f4407"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:45.974918 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:45.974918 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:15:45.985807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-3c707fec-8166-44e2-9461-269de15d0cfe req-50693498-7afa-4548-99aa-b3b241a09f69 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:45.986364 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-3c707fec-8166-44e2-9461-269de15d0cfe req-50693498-7afa-4548-99aa-b3b241a09f69 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.007401 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-3c707fec-8166-44e2-9461-269de15d0cfe req-50693498-7afa-4548-99aa-b3b241a09f69 service nova] Creating event network-changed:d959c80e-06c3-41aa-8b1d-d2db534f4407 for instance b0c10d18-b689-4550-a354-e0b0594039b3 on hv-cinder-78776 Nov 16 16:15:46.007935 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-3c707fec-8166-44e2-9461-269de15d0cfe req-50693498-7afa-4548-99aa-b3b241a09f69 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 16 16:15:46.009090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eca4b33-e8d7-409d-91c2-7556709083a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.009677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eca4b33-e8d7-409d-91c2-7556709083a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.010527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eca4b33-e8d7-409d-91c2-7556709083a3 None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.010961 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eca4b33-e8d7-409d-91c2-7556709083a3 None None] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.021773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:46.022478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:46.032455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.032819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.033646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.034257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.038626 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.compute.rpcapi [None req-4eca4b33-e8d7-409d-91c2-7556709083a3 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 16 16:15:46.039694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eca4b33-e8d7-409d-91c2-7556709083a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=116167) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 16 16:15:46.079237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4eca4b33-e8d7-409d-91c2-7556709083a3 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120308 Nov 16 16:15:46.079829 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 37/72] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:46.193587 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:46.201692 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d65c7328-9621-4105-9441-91a0aa029d8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.183527 Nov 16 16:15:46.206622 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 36/73] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:46 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:46.675561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:46.676635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:46.683035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.683554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.684441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.685487 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.834546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:46.843608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b2405f48-8d4b-4783-85c3-2eb35f056321 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.172736 Nov 16 16:15:46.844285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 38/74] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:46 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:46.972742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:46.973954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:46.975465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:46.977072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:46.980333 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.980931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.981844 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.982458 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.983114 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.983555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:46.984698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:46.985140 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:47.196686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:47.206103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b9d7f9b0-6a30-40f4-a94a-a1f7312fa16b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.234412 Nov 16 16:15:47.207085 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 39/75] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:46 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:47.213152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:47.223131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-26206981-65dd-43bb-a355-d72a3e144577 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.253953 Nov 16 16:15:47.223681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:47.223807 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 37/76] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:46 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:47.224677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:47.231062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:47.231579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:47.232453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:47.232943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:47.386691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:47.394411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-84cbac08-492e-4fad-a8e7-db5263ad54f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.174730 Nov 16 16:15:47.395072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 40/77] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:47 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:47.860405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:47.861051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:47.867559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:47.868007 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:47.868789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:47.869233 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:48.009016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:48.016399 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3d6d2536-f737-45d9-bb64-59f56f5a15bc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.159638 Nov 16 16:15:48.017001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 38/78] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:47 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:48.224619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:48.225243 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:48.231687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:48.232138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:48.232928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:48.234146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:48.239688 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:48.240316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:48.246480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:48.246947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:48.247690 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:48.248115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:48.440251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:48.450146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-86e457f8-1626-4946-bab0-7f358718ccd3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.229364 Nov 16 16:15:48.452475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 41/79] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:48 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:48.458506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:48.459475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:48.469604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:48.475627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:48.478253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:48.480845 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-27ce730a-fd2c-4e74-ab79-39b43b6dc812 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.244785 Nov 16 16:15:48.481809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 39/80] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:48 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:48.482874 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:48.483501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:48.640654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:48.651605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7c0f151e-19e7-43d8-83fb-6b5e5934b0f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.197577 Nov 16 16:15:48.652677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 42/81] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:48 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:49.035257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:49.035888 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:49.043295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:49.044126 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:49.044958 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:49.045400 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:49.243917 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:49.257831 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eba68d13-41c1-490d-ab90-c2536380401d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.226636 Nov 16 16:15:49.258829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 40/82] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:49 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:49.473297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:49.474657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:49.481559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:49.482335 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:49.483403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:49.484055 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:49.499163 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:49.499874 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:49.513801 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:49.514703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:49.515629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:49.516192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:50.276006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:50.286062 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2870696e-fdde-4a5d-a770-ba4e8fc3ee5b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.791219 Nov 16 16:15:50.289941 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 41/83] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:49 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:50.310139 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:50.314267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:50.318158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:50.323960 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-689bc27b-8dc3-4b72-a02f-ad8ea495e307 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.854237 Nov 16 16:15:50.328230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 43/84] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:49 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:50.336852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:50.338972 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:50.339738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:50.340288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:50.341284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:50.343585 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:50.353040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:50.354857 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:50.355881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:50.373908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:50.779426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:50.788909 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-053d5241-2704-41d9-87b2-e08f52724dfa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.457553 Nov 16 16:15:50.803702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 44/85] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:50 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:50.816648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-597bc2b4-08da-4379-86e8-a9a804fbd922 req-eda57b41-6bb5-463b-89e8-aac96ac82851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0d2f3-de31-4eda-aed0-b37837391d69", "tag": "5346365d-2fa2-4b19-bfdf-0c87d7b25d3d"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:50.822573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:50.822573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:15:50.840767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-597bc2b4-08da-4379-86e8-a9a804fbd922 req-eda57b41-6bb5-463b-89e8-aac96ac82851 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:50.842465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-597bc2b4-08da-4379-86e8-a9a804fbd922 req-eda57b41-6bb5-463b-89e8-aac96ac82851 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:50.859065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:50.872956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2cc1507b-f073-4024-9d61-c06ae833de0e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.580157 Nov 16 16:15:50.874661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-597bc2b4-08da-4379-86e8-a9a804fbd922 req-eda57b41-6bb5-463b-89e8-aac96ac82851 service nova] Creating event network-changed:5346365d-2fa2-4b19-bfdf-0c87d7b25d3d for instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 on hv-cinder-78776 Nov 16 16:15:50.876158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 42/86] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:50 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:50.886331 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-597bc2b4-08da-4379-86e8-a9a804fbd922 req-eda57b41-6bb5-463b-89e8-aac96ac82851 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078345 Nov 16 16:15:50.887965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 45/87] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:15:51.308713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:51.309722 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:51.318958 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.319681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.320476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.321129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.343827 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:51.344774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:51.351755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.352429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.353432 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.354022 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.553184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:51.559159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:51.562914 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0e7fb922-c16a-486a-840d-b6382e6004b7 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.260059 Nov 16 16:15:51.563503 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 43/88] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:51 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:51.570076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-886f3e36-3f8a-491f-bb36-53ec2fdd75c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.230174 Nov 16 16:15:51.571633 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 46/89] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:51 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:51.808387 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:51.808915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:51.815182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.815597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.816567 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.817189 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.893966 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:51.895215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:51.912787 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.913330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.914214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:51.914789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:51.975102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:51.984238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5496545a-2c09-4fb7-aa65-2b7ed44b2312 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.179468 Nov 16 16:15:51.993748 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 44/90] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:51 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:52.080027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:52.088378 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5063a85d-9a54-4f18-a5d0-6514a19a39a7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.200160 Nov 16 16:15:52.110017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 47/91] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:51 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:52.580190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:52.580878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:52.587118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:52.587828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:52.589077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:52.589246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:52.589791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:52.590138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:52.596455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:52.597017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:52.597836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:52.598406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:52.805571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:52.811216 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:52.813688 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c0a3e79a-2849-479e-9fdc-3c39eb781f85 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.228384 Nov 16 16:15:52.816304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 48/92] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:52 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:52.824399 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2c576ec7-0f64-4758-9ab6-3cb1f5786370 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.247930 Nov 16 16:15:52.825463 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 45/93] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:52 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:53.001143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:53.001947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:53.007843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.008289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:53.009083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.009509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:53.116119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:53.117175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:53.132398 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.133088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:53.134068 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.134696 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:53.164559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:53.175208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e83eea37-1536-4bf0-9de2-08838718a4f4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.177817 Nov 16 16:15:53.175880 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 49/94] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:52 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:53.303336 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:53.311212 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d5825d01-3643-45f0-abad-767e52d972d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.198506 Nov 16 16:15:53.321817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 46/95] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:53 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:53.834034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:53.834784 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:53.842757 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:53.842757 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:53.845837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.846469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:53.847357 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.847844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:53.848449 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.848876 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:53.849878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:53.850308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:54.043971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:54.047782 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:54.052272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f043e203-f700-4371-8792-31ee37d7bcbc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.222643 Nov 16 16:15:54.052931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 50/96] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:53 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:54.055854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-463483d9-92f4-4174-a5b1-68b98656c275 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.218639 Nov 16 16:15:54.056424 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 47/97] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:53 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:54.192618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:54.193238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:54.199542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:54.200058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:54.200916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:54.201448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:54.328402 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:54.329005 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:54.335037 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:54.335480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:54.336241 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:54.336995 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:54.339389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:54.347685 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-beab7245-8c82-494c-9c20-3ee4d0ed7294 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.159088 Nov 16 16:15:54.354842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 51/98] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:54 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:54.487562 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:54.494875 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-45e87593-2c13-43c9-823f-bd4e66bddbc4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.170125 Nov 16 16:15:54.495505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 48/99] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:54 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:55.069475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:55.069985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:55.072706 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:55.073313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:55.079181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.079622 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.080471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.080879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.081105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.081617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.082512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.082983 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.338826 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:55.339025 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:55.347126 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c81f9066-1388-487b-a9d5-a5e53c86bfe9 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.278021 Nov 16 16:15:55.348244 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 49/100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:55 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:55.351636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c996e19b-fd46-4493-bd27-20155f6f24bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.286235 Nov 16 16:15:55.352410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 52/101] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:55 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:55.364488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:55.365103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:55.371073 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.371510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.372286 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.372714 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.513459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:55.516850 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:55.517701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:55.526310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d1ec9022-a16d-4366-9692-cfd497533ddf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.165378 Nov 16 16:15:55.527249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 50/102] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:55 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:55.527667 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.528235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.529120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:55.529676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:55.668612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:55.676233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d9df3ecd-de84-4d66-ae6b-b047c2ed4996 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.165904 Nov 16 16:15:55.676795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 53/103] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:55 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:56.369174 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:56.369769 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:56.370127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:56.378940 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:56.384632 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.387551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.388209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.388663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.391682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.392241 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.393911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.394184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.641981 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:56.646354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:56.653705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-372fd0e9-c596-42e7-b207-7ae4371f7baa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.286937 Nov 16 16:15:56.655875 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 51/104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:56 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:56.659159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e6079861-4a4c-4c17-a665-3e7e65c3ae4c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.294106 Nov 16 16:15:56.664714 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:56.666586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:56.670314 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 54/105] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:56 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:56.677403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.678142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.679584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.680200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.695994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:56.696714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:56.712748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.713208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.714188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:56.714654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:56.989835 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:56.997804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7030f943-89c9-4605-84aa-04d8f4b46c2e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.340782 Nov 16 16:15:57.002445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 52/106] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:56 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:57.039429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:57.052738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cdb4cae5-d42d-48b9-89ed-7a163df3740f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.360557 Nov 16 16:15:57.054007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 55/107] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:56 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:57.673615 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:57.674326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:57.676262 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:57.676944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:57.682806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:57.683362 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:57.683824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:57.684232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:57.684605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:57.685034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:57.685692 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:57.687092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:57.946496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:57.957509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-729979ef-a6e6-4acc-94b9-c770b1a5b3d4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.283560 Nov 16 16:15:57.967828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 56/108] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:57 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:57.977731 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:57.985514 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fdde17b8-4e67-4d0c-aad2-2704b1d15966 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.317847 Nov 16 16:15:57.986145 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 53/109] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:57 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:58.017013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:58.017694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:58.023898 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.024653 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.025588 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.026045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.070690 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:58.071506 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:58.080019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.081219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.091405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.092183 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.318350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:58.327667 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6b322811-f6eb-42a5-b108-17a0f8c6c483 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.314450 Nov 16 16:15:58.335374 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 57/110] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:58 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:58.382279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:58.390656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-69af0034-039f-4585-aab0-ad852beead1c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.323653 Nov 16 16:15:58.391301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 54/111] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:58 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:58.557639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-3e3565bf-1241-441f-a19b-4efdde2bd072 req-36ea74d3-e7ed-4677-8b45-dfb3b4df6ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4a1e6e-5d38-4c3e-8381-112022eb6207", "name": "network-vif-plugged", "status": "completed", "tag": "975ed373-f034-4688-b3e3-efe810e76c1c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:15:58.559345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:15:58.559345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:15:58.569194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-3e3565bf-1241-441f-a19b-4efdde2bd072 req-36ea74d3-e7ed-4677-8b45-dfb3b4df6ba4 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.569635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-3e3565bf-1241-441f-a19b-4efdde2bd072 req-36ea74d3-e7ed-4677-8b45-dfb3b4df6ba4 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.593821 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-3e3565bf-1241-441f-a19b-4efdde2bd072 req-36ea74d3-e7ed-4677-8b45-dfb3b4df6ba4 service nova] Creating event network-vif-plugged:975ed373-f034-4688-b3e3-efe810e76c1c for instance cc4a1e6e-5d38-4c3e-8381-112022eb6207 on hv-cinder-78776 Nov 16 16:15:58.600868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-3e3565bf-1241-441f-a19b-4efdde2bd072 req-36ea74d3-e7ed-4677-8b45-dfb3b4df6ba4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236859 Nov 16 16:15:58.601885 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 58/112] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:15:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:15:58.977273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:58.978012 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:58.985624 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.986536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:58.988820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:58.990140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.006940 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:59.008190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:59.015627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.016370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.029748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.030668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.282267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:59.290311 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a0c360e6-16b9-445b-88b9-9ff1623d6bf4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.318382 Nov 16 16:15:59.300586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 55/113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:58 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:15:59.304182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:59.312233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9f2c2c0f-6ac7-454b-be8e-7e01aef63c13 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.310485 Nov 16 16:15:59.322693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 59/114] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:59 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:59.348887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:59.349543 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:59.355459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.356051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.356969 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.357547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.415461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:15:59.416506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:15:59.425595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.426046 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.427066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:15:59.427641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:15:59.537719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:59.552438 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e8d4bcea-ae97-4e92-ad08-0c4ff6f28846 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.207239 Nov 16 16:15:59.553022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 56/115] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:59 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:15:59.603437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:15:59.612913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-eceba7e2-e769-4e6d-8742-6bd1f902fda9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.208524 Nov 16 16:15:59.613780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 60/116] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:15:59 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:00.307746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:00.308352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:00.315262 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.316120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:00.317451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.318106 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:00.329457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:00.330157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:00.338237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.340805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:00.341797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.345287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:00.735460 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:00.746677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6a59d9e9-777e-4b63-a263-6bddd27bfeca tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.417891 Nov 16 16:16:00.748315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 61/117] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:00 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:00.757996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:00.773480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3e01fccf-0c50-4d8f-be03-3eefc27b1d3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.466207 Nov 16 16:16:00.775346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:00.776508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 57/118] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:00 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:00.777068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:00.784279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:00.785337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:00.793955 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.794487 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.794961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:00.796409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.797654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:00.797812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:00.799216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:00.803025 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:01.058802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:01.064063 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:01.069100 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e8d724dd-b045-4043-b5b0-db84e136a204 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.290578 Nov 16 16:16:01.070849 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 58/119] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:00 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:01.081586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-865432d6-825f-4ced-ad80-22b84fbbedd0 req-7456b09c-fd46-461a-83d0-0c5552aa9b52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404a11e5-c791-46cd-b455-ef6eca512695", "name": "network-vif-plugged", "status": "completed", "tag": "47508073-20f8-411c-b5ec-1fee3ead99b0"}, {"server_uuid": "ca96c22d-d0ae-48e0-9f0f-fa02d0324fec", "name": "network-vif-plugged", "status": "completed", "tag": "85446dc9-e1a3-4e4d-90db-94d908195108"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:01.083027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e3fa04b8-86c7-40d8-92a1-39ad8b7cdfcd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1318 microversion: 2.1 time: 0.333496 Nov 16 16:16:01.084058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 62/120] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:00 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:01.094032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:01.094032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:16:01.098999 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-865432d6-825f-4ced-ad80-22b84fbbedd0 req-7456b09c-fd46-461a-83d0-0c5552aa9b52 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:01.100088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-865432d6-825f-4ced-ad80-22b84fbbedd0 req-7456b09c-fd46-461a-83d0-0c5552aa9b52 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:01.117054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-865432d6-825f-4ced-ad80-22b84fbbedd0 req-7456b09c-fd46-461a-83d0-0c5552aa9b52 service nova] Creating event network-vif-plugged:47508073-20f8-411c-b5ec-1fee3ead99b0 for instance 404a11e5-c791-46cd-b455-ef6eca512695 on hv-cinder-78776 Nov 16 16:16:01.117978 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-865432d6-825f-4ced-ad80-22b84fbbedd0 req-7456b09c-fd46-461a-83d0-0c5552aa9b52 service nova] Creating event network-vif-plugged:85446dc9-e1a3-4e4d-90db-94d908195108 for instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec on hv-cinder-78776 Nov 16 16:16:01.145976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-865432d6-825f-4ced-ad80-22b84fbbedd0 req-7456b09c-fd46-461a-83d0-0c5552aa9b52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073866 Nov 16 16:16:01.147318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 59/121] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:01 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:01.764430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:01.765015 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:01.772095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:01.772806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:01.774510 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:01.775812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:01.794147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:01.795755 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:01.804495 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:01.805820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:01.807009 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:01.807649 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:02.272140 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:02.273277 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:02.285754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b457a172-aba5-47cb-a8e0-3f9fb1200453 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.524947 Nov 16 16:16:02.286135 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9b5d8c5b-8405-4e68-ad48-b6ef0a305666 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.496953 Nov 16 16:16:02.287195 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 60/122] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:01 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:02.290851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 63/123] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:01 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:02.300477 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:02.302300 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:02.303251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:02.303873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:02.312181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:02.312731 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:02.316036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:02.317041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:02.318254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:02.318988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:02.322261 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:02.324030 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:02.558346 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:02.568373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:02.577360 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c3d313fa-2e39-497d-8072-14c597ab1f99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1508 microversion: 2.1 time: 0.285077 Nov 16 16:16:02.577945 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 64/124] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:02 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:02.582449 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f738880f-18db-4ddc-bcff-06823af7167d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.293962 Nov 16 16:16:02.583222 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 61/125] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:02 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:03.316468 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:03.317084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:03.322139 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:03.325606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:03.334194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.340111 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:03.340942 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.341360 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:03.341746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.342426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:03.343373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.359247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:03.617982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:03.628661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2a5d0103-8e87-4c0f-9a91-077b865c39a3 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1315 microversion: 2.1 time: 0.319086 Nov 16 16:16:03.638735 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 62/126] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:03 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:03.645518 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:03.651980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:03.655115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:03.660283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4abd97d4-bc9f-4f1a-b073-68016c8cc6cd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.346834 Nov 16 16:16:03.661154 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 65/127] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:03 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:03.664582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.665230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:03.666158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.666763 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:03.857575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:03.866230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a868fcd7-9125-49fa-ae3d-095d497d54d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.225912 Nov 16 16:16:03.867851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 63/128] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:03 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:03.975104 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2605bb85-b339-4757-b5de-63ce8540c52b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7af89d6f-4351-4a99-80ee-ffe57f7cf193"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:03.976232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2605bb85-b339-4757-b5de-63ce8540c52b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:03.983261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2605bb85-b339-4757-b5de-63ce8540c52b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.983783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2605bb85-b339-4757-b5de-63ce8540c52b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:03.984638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2605bb85-b339-4757-b5de-63ce8540c52b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:03.985064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2605bb85-b339-4757-b5de-63ce8540c52b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:04.039459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-0cbe34d1-66cb-43ac-a0b7-08ca3fe8f974 req-6d6c5641-08ea-4b70-9816-349894a38f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff0d2f3-de31-4eda-aed0-b37837391d69", "name": "network-vif-plugged", "status": "completed", "tag": "5346365d-2fa2-4b19-bfdf-0c87d7b25d3d"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:04.041337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:04.041337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:16:04.049538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-0cbe34d1-66cb-43ac-a0b7-08ca3fe8f974 req-6d6c5641-08ea-4b70-9816-349894a38f90 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:04.050223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-0cbe34d1-66cb-43ac-a0b7-08ca3fe8f974 req-6d6c5641-08ea-4b70-9816-349894a38f90 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:04.063389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-0cbe34d1-66cb-43ac-a0b7-08ca3fe8f974 req-6d6c5641-08ea-4b70-9816-349894a38f90 service nova] Creating event network-vif-plugged:5346365d-2fa2-4b19-bfdf-0c87d7b25d3d for instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 on hv-cinder-78776 Nov 16 16:16:04.069974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-0cbe34d1-66cb-43ac-a0b7-08ca3fe8f974 req-6d6c5641-08ea-4b70-9816-349894a38f90 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034275 Nov 16 16:16:04.071074 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 64/129] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:04.460728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2605bb85-b339-4757-b5de-63ce8540c52b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489127 Nov 16 16:16:04.466478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 66/130] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:16:03 2021] POST /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments => generated 194 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:04.647176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:04.648095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:04.657170 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:04.657783 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:04.658611 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:04.659260 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:04.678409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:04.679102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:04.690487 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:04.690964 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:04.691734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:04.692160 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:04.894520 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:04.907607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b362b30f-bcc5-4ca7-8780-5260ab69fb8a tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1501 microversion: 2.1 time: 0.265434 Nov 16 16:16:04.909104 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:04.909862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 65/131] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:04 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1501 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:04.918682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:04.920667 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:04.931910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-34f776cf-a1bc-4669-afe2-6ce1b7d63248 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.258145 Nov 16 16:16:04.932492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 67/132] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:04 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:04.947954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:04.948393 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:04.949184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:04.949611 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:05.133075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:05.142310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-95d5584d-57ed-4556-bb05-be8a6cad56c0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1361 microversion: 2.1 time: 0.230204 Nov 16 16:16:05.143120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 66/133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:04 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:05.959204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:05.961334 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:05.968963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:05.969785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:05.972817 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:05.973466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:06.097293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-522919af-8ff2-4ed7-bab1-3cbd334667b0 req-90116fed-f6aa-401a-998d-97c8eaebc464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c10d18-b689-4550-a354-e0b0594039b3", "name": "network-vif-plugged", "status": "completed", "tag": "d959c80e-06c3-41aa-8b1d-d2db534f4407"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:06.101726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:06.101726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:16:06.116536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-522919af-8ff2-4ed7-bab1-3cbd334667b0 req-90116fed-f6aa-401a-998d-97c8eaebc464 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:06.117040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-522919af-8ff2-4ed7-bab1-3cbd334667b0 req-90116fed-f6aa-401a-998d-97c8eaebc464 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:06.129865 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-522919af-8ff2-4ed7-bab1-3cbd334667b0 req-90116fed-f6aa-401a-998d-97c8eaebc464 service nova] Creating event network-vif-plugged:d959c80e-06c3-41aa-8b1d-d2db534f4407 for instance b0c10d18-b689-4550-a354-e0b0594039b3 on hv-cinder-78776 Nov 16 16:16:06.135059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-522919af-8ff2-4ed7-bab1-3cbd334667b0 req-90116fed-f6aa-401a-998d-97c8eaebc464 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042890 Nov 16 16:16:06.135954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 67/134] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:06.162772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:06.166550 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:06.166972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:06.177119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:06.177824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:06.178994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:06.179784 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:06.190728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-74aaccb9-3d41-4dd6-b599-b047d1b31dc5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.238402 Nov 16 16:16:06.193133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 68/135] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:05 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:06.440238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:06.453510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c2b97a90-88d8-42d8-99b4-899d69abb277 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1548 microversion: 2.1 time: 0.292514 Nov 16 16:16:06.453510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 68/136] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:06 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1548 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:06.465708 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e6167c8a-b672-4327-99d3-519eb040e3b8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:06.466192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e6167c8a-b672-4327-99d3-519eb040e3b8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:06.472976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6167c8a-b672-4327-99d3-519eb040e3b8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:06.474536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6167c8a-b672-4327-99d3-519eb040e3b8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:06.475737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6167c8a-b672-4327-99d3-519eb040e3b8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:06.476450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6167c8a-b672-4327-99d3-519eb040e3b8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:06.624384 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e6167c8a-b672-4327-99d3-519eb040e3b8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162561 Nov 16 16:16:06.624973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 69/137] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Nov 16 16:16:06 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:06.733904 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-50b721b5-88b5-4a67-ac8a-6c9891068c32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5353500-cd11-468c-84d0-8d17799675d8"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:06.735044 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-50b721b5-88b5-4a67-ac8a-6c9891068c32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:06.742828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-50b721b5-88b5-4a67-ac8a-6c9891068c32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:06.743564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-50b721b5-88b5-4a67-ac8a-6c9891068c32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:06.744379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-50b721b5-88b5-4a67-ac8a-6c9891068c32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:06.744956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-50b721b5-88b5-4a67-ac8a-6c9891068c32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:07.212121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:07.212906 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:07.222052 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:07.222835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:07.223800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:07.224404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:07.331510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-50b721b5-88b5-4a67-ac8a-6c9891068c32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "POST /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601218 Nov 16 16:16:07.332524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 69/138] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:16:06 2021] POST /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695/os-volume_attachments => generated 194 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:07.685330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:07.694970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ed183daa-f4c9-4255-a0c2-3200b78f437c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1321 microversion: 2.1 time: 0.488833 Nov 16 16:16:07.717700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 70/139] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:07 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1321 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:08.470651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-821182b4-2309-4a4c-bb95-4d7f74950059 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:08.471357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-821182b4-2309-4a4c-bb95-4d7f74950059 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:08.488878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821182b4-2309-4a4c-bb95-4d7f74950059 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:08.489326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821182b4-2309-4a4c-bb95-4d7f74950059 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:08.493533 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821182b4-2309-4a4c-bb95-4d7f74950059 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:08.493990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-a49a173d-7806-444a-a653-225e176e6ddb req-18cdab58-b6bb-4340-a65c-2ebf6fe4301d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff0d2f3-de31-4eda-aed0-b37837391d69", "tag": "5346365d-2fa2-4b19-bfdf-0c87d7b25d3d"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:08.494532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-821182b4-2309-4a4c-bb95-4d7f74950059 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:08.496708 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:08.496708 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:16:08.507805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a49a173d-7806-444a-a653-225e176e6ddb req-18cdab58-b6bb-4340-a65c-2ebf6fe4301d service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:08.509656 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a49a173d-7806-444a-a653-225e176e6ddb req-18cdab58-b6bb-4340-a65c-2ebf6fe4301d service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:08.524621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-a49a173d-7806-444a-a653-225e176e6ddb req-18cdab58-b6bb-4340-a65c-2ebf6fe4301d service nova] Creating event network-changed:5346365d-2fa2-4b19-bfdf-0c87d7b25d3d for instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 on hv-cinder-78776 Nov 16 16:16:08.531304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-a49a173d-7806-444a-a653-225e176e6ddb req-18cdab58-b6bb-4340-a65c-2ebf6fe4301d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043399 Nov 16 16:16:08.531902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 71/140] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:08.589519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-821182b4-2309-4a4c-bb95-4d7f74950059 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 0.118469 Nov 16 16:16:08.592990 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 70/141] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:08 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:08.735406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:08.736298 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:08.743459 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:08.743899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:08.744890 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:08.746587 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:09.043606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:09.052400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-38f24164-36a6-4691-a4b6-a363ab591d40 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1515 microversion: 2.1 time: 0.321891 Nov 16 16:16:09.054922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 72/142] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:08 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1515 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:09.074014 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:09.075539 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:09.089141 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:09.089601 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:09.090418 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:09.091051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:09.118998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lazy-loading 'flavor' on Instance uuid b0c10d18-b689-4550-a354-e0b0594039b3 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:16:09.262723 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d9a418ca-8268-4485-906f-8e834d0fbdcb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3/action" status: 200 len: 32 microversion: 2.1 time: 0.194717 Nov 16 16:16:09.263346 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 71/143] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:09 2021] POST /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:09.272611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:09.273477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:09.281677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:09.282116 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:09.283651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:09.284299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:09.521006 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:09.530427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-843967c3-0ad3-418a-9dac-1697462513f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.261541 Nov 16 16:16:09.536686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 73/144] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:09 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:09.601975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f43e6cad-8ca2-4902-83f9-e9eadeb19cee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:09.604263 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f43e6cad-8ca2-4902-83f9-e9eadeb19cee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:09.613482 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f43e6cad-8ca2-4902-83f9-e9eadeb19cee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:09.613935 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f43e6cad-8ca2-4902-83f9-e9eadeb19cee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:09.614757 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f43e6cad-8ca2-4902-83f9-e9eadeb19cee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:09.615412 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f43e6cad-8ca2-4902-83f9-e9eadeb19cee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:09.687973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f43e6cad-8ca2-4902-83f9-e9eadeb19cee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 0.090397 Nov 16 16:16:09.691350 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 72/145] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:09 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:10.550090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:10.551741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:10.559675 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:10.560197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:10.560983 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:10.561420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:10.700091 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3d4af538-1cc3-47ed-86b2-612074d1975c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:10.701863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3d4af538-1cc3-47ed-86b2-612074d1975c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:10.709325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d4af538-1cc3-47ed-86b2-612074d1975c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:10.709996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d4af538-1cc3-47ed-86b2-612074d1975c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:10.710819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d4af538-1cc3-47ed-86b2-612074d1975c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:10.711217 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d4af538-1cc3-47ed-86b2-612074d1975c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:10.712264 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:10.721333 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4686c9eb-04e4-42aa-abb8-495171b52d60 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.175836 Nov 16 16:16:10.727214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 74/146] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:10 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:10.786276 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3d4af538-1cc3-47ed-86b2-612074d1975c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 0.090778 Nov 16 16:16:10.787127 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 73/147] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:10 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:16:11.737948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:11.738655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:11.745212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:11.745768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:11.746781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:11.747442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:11.798064 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ea1c7a93-e0a8-4143-92ef-0fe5adce8b34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:11.802001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ea1c7a93-e0a8-4143-92ef-0fe5adce8b34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:11.810475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea1c7a93-e0a8-4143-92ef-0fe5adce8b34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:11.811052 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea1c7a93-e0a8-4143-92ef-0fe5adce8b34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:11.811927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea1c7a93-e0a8-4143-92ef-0fe5adce8b34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:11.812454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea1c7a93-e0a8-4143-92ef-0fe5adce8b34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:11.897175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:11.905130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3e2eff66-4d13-464b-badc-0502aef3feb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.170950 Nov 16 16:16:11.905899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 75/148] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:11 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:12.927890 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:12.928547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:12.935697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:12.935697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:12.936101 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:12.936654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:13.092748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:13.100550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-eb8b28f1-6279-45c2-80c1-ed6cb6fe5492 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.182217 Nov 16 16:16:13.101125 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 76/149] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:12 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:14.120163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:14.120845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:14.127328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:14.128939 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:14.129929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:14.130477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:14.365313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:14.375539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2db6f3da-7675-4225-afed-3e7df68fbbbb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.259414 Nov 16 16:16:14.377235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 77/150] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:14 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:14.458799 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ea1c7a93-e0a8-4143-92ef-0fe5adce8b34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 2.664637 Nov 16 16:16:14.460564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 74/151] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:11 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 2667 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:15.394024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:15.394810 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:15.403766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:15.404396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:15.405282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:15.405965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:15.472864 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-76e7a1bc-7db9-4816-8ba8-3220619bc895 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:15.474048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-76e7a1bc-7db9-4816-8ba8-3220619bc895 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:15.500923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76e7a1bc-7db9-4816-8ba8-3220619bc895 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:15.506450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76e7a1bc-7db9-4816-8ba8-3220619bc895 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:15.510538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76e7a1bc-7db9-4816-8ba8-3220619bc895 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:15.511069 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76e7a1bc-7db9-4816-8ba8-3220619bc895 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:15.659126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:15.667053 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-17eedcde-e2dc-4209-90c3-601f2dca85cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.277398 Nov 16 16:16:15.676958 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 78/152] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:15 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:16.345553 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-76e7a1bc-7db9-4816-8ba8-3220619bc895 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 0.878155 Nov 16 16:16:16.348382 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 75/153] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:15 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:16.688556 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:16.689405 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:16.698982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:16.699672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:16.701019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:16.702045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:16.856180 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:16.864682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0f4f63f4-ee40-41ff-a036-c7f10bfa8de1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.182721 Nov 16 16:16:16.865250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 79/154] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:16 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:17.360289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3c049272-dd63-420e-aef3-6f15cc8f3e26 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:17.361575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3c049272-dd63-420e-aef3-6f15cc8f3e26 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:17.369677 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c049272-dd63-420e-aef3-6f15cc8f3e26 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:17.370084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c049272-dd63-420e-aef3-6f15cc8f3e26 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:17.370910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c049272-dd63-420e-aef3-6f15cc8f3e26 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:17.371334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c049272-dd63-420e-aef3-6f15cc8f3e26 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:17.463043 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3c049272-dd63-420e-aef3-6f15cc8f3e26 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 0.107738 Nov 16 16:16:17.463838 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 76/155] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:17 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:17.882822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:17.883399 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:17.889845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:17.890299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:17.891083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:17.891493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:18.030910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:18.038792 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-62ffde6a-ef6b-489a-867a-2ba78f3d38e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.161141 Nov 16 16:16:18.039370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 80/156] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:17 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:18.054981 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-875831700", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "d84afc5c-5a15-4a00-9306-51fa977143c5"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:18.110472 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] validate_networks() for [('d84afc5c-5a15-4a00-9306-51fa977143c5', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:16:18.475685 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3905c9d8-8fe7-44eb-a02a-10ab62530f80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:18.476628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3905c9d8-8fe7-44eb-a02a-10ab62530f80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:18.479276 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:16:18.479888 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:16:18.480363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:16:18.480953 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:16:18.481890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:16:18.483190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3905c9d8-8fe7-44eb-a02a-10ab62530f80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:18.483639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3905c9d8-8fe7-44eb-a02a-10ab62530f80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:18.484423 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3905c9d8-8fe7-44eb-a02a-10ab62530f80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:18.484853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3905c9d8-8fe7-44eb-a02a-10ab62530f80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:18.493671 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:18.494121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:18.495097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:18.495557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:18.513518 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Getting quotas for project bd35ac8531424c33bb44b731249fdcde. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:16:18.517348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Getting quotas for user f9f6fc7adb31457095b9e6cb4595390d and project bd35ac8531424c33bb44b731249fdcde. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:16:18.528182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:16:18.530660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:16:18.577094 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3f083d89-b6ac-4225-be40-f9f3b45503fa tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526741 Nov 16 16:16:18.577969 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 77/157] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:16:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:16:18.590667 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-444ac56a-9a27-43db-a22e-1c71817ce4c3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:18.591301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-444ac56a-9a27-43db-a22e-1c71817ce4c3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:18.644485 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-444ac56a-9a27-43db-a22e-1c71817ce4c3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:18.653715 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-444ac56a-9a27-43db-a22e-1c71817ce4c3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1218 microversion: 2.1 time: 0.067418 Nov 16 16:16:18.653715 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 78/158] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:18 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:19.058032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:19.058714 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:19.065484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:19.065931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:19.066737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:19.067198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:19.199997 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:19.210216 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cf296a6b-58f8-4c71-8743-00117cf2530e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.155521 Nov 16 16:16:19.210923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 79/159] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:19 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:19.674968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:19.675892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:19.682958 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:19.683438 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:19.684197 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:19.684626 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:19.748800 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:19.756631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1c58f04a-c5ba-491a-bd2b-a74c6aec10ec tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1222 microversion: 2.1 time: 0.087736 Nov 16 16:16:19.757242 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 80/160] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:19 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:20.228658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:20.229303 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:20.236152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:20.236679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:20.237570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:20.238018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:20.389463 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:20.397450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-07bcb133-68e2-48ed-bbc1-19e5d086ca50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.173308 Nov 16 16:16:20.397996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 81/161] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:20 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:20.776170 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:20.776772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:20.782981 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:20.783424 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:20.784204 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:20.784750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:20.846073 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:20.854018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-27713908-1a4d-40d7-93ed-f34c904f7aa7 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1222 microversion: 2.1 time: 0.084332 Nov 16 16:16:20.854780 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 82/162] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:20 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:21.415229 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:21.415833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:21.423460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:21.423906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:21.424683 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:21.425113 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:21.562519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:21.570826 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5379465a-7be2-4e96-8662-69c8ec4a5739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.159336 Nov 16 16:16:21.571386 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 83/163] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:21 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:21.839236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2061842823", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "87532d28-954d-488e-beef-2ed2275c6575"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:21.895289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] validate_networks() for [('87532d28-954d-488e-beef-2ed2275c6575', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:16:22.259924 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:16:22.260338 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:16:22.260881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:16:22.261315 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:16:22.261816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:16:22.270604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:22.271081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:22.271893 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:22.272571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:22.296098 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:16:22.299924 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for user 99d58fe781aa40b2abf368dcc69b1a53 and project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:16:22.311746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:16:22.313988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:16:22.360831 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9395ec9c-094d-4709-b690-8d15e778ff16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525988 Nov 16 16:16:22.361847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 84/164] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:16:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:16:22.372237 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:22.372237 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:22.380833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:22.380833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:22.380833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:22.380833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:22.452970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:22.460484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0ed9b5a4-082a-4316-9664-ce0a3a8af58e tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1222 microversion: 2.1 time: 0.097047 Nov 16 16:16:22.461123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 85/165] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:22 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:22.465846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b054b8d7-0188-4a32-ad64-4431a8f75abc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:22.466462 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b054b8d7-0188-4a32-ad64-4431a8f75abc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:22.522209 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b054b8d7-0188-4a32-ad64-4431a8f75abc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:22.530127 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b054b8d7-0188-4a32-ad64-4431a8f75abc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1218 microversion: 2.1 time: 0.068007 Nov 16 16:16:22.530660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 86/166] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:22 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:22.590723 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:22.591374 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:22.597732 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:22.598176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:22.598974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:22.599397 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:22.737053 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:22.745215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cdd23c7e-96de-4772-94a4-ee8a37226c50 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.160753 Nov 16 16:16:22.745750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 87/167] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:22 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:23.107640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3905c9d8-8fe7-44eb-a02a-10ab62530f80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 4.635604 Nov 16 16:16:23.112252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 81/168] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:18 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 4637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:16:23.481937 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:23.482729 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:23.490553 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:23.491001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:23.491783 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:23.492219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:23.546807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:23.547497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:23.553166 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:23.554794 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:23.555223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:23.556089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:23.556509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:23.561207 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9a0e1d63-4dab-40dc-abc8-9693d34b29fd tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1270 microversion: 2.1 time: 0.087304 Nov 16 16:16:23.561863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 88/169] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:23 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:23.618746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:23.627786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3e73848e-b8b6-484b-8134-93ec08a23262 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1214 microversion: 2.1 time: 0.084736 Nov 16 16:16:23.628635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 82/170] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:23 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:23.763093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:23.763804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:23.769812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:23.770252 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:23.771061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:23.771492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:23.930564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:23.944258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c2cabb32-6d6b-40e7-a41b-0de84cf0a53b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.184507 Nov 16 16:16:23.944590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 89/171] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:23 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:24.119741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-97203c10-2b19-4acb-833d-c055aa982633 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:24.120700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-97203c10-2b19-4acb-833d-c055aa982633 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:24.127275 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97203c10-2b19-4acb-833d-c055aa982633 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.127727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97203c10-2b19-4acb-833d-c055aa982633 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:24.128521 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97203c10-2b19-4acb-833d-c055aa982633 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.128975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97203c10-2b19-4acb-833d-c055aa982633 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:24.239335 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-97203c10-2b19-4acb-833d-c055aa982633 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 0.123379 Nov 16 16:16:24.240169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 83/172] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:24 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:24.579481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:24.579481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:24.591387 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.592907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:24.594776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.595472 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:24.652962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:24.659598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:24.670436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.673311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:24.676637 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.677247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:24.828838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:24.837489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9e114246-7f78-4627-9c1c-be6f56cb2677 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1276 microversion: 2.1 time: 0.193087 Nov 16 16:16:24.838130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 84/173] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:24 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:24.961202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:24.962280 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:24.973482 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.973926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:24.974750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:24.975339 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:25.183426 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:25.193132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5af08f54-df00-48fd-9ff3-a1763b99a624 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.618254 Nov 16 16:16:25.193682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 90/174] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:24 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:25.198614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1480838588", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "4c7bff69-03f4-470d-bf73-a6b29d12152a"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:25.253032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] validate_networks() for [('4c7bff69-03f4-470d-bf73-a6b29d12152a', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:16:25.346562 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:25.355178 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-58ba1d73-e061-4122-b655-2e07382aa1f4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.397704 Nov 16 16:16:25.355648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 85/175] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:24 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:25.361040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-171abd65-b52a-411d-8d9d-70cfc631d047 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:25.362684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-171abd65-b52a-411d-8d9d-70cfc631d047 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:25.378103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-171abd65-b52a-411d-8d9d-70cfc631d047 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:25.378922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-171abd65-b52a-411d-8d9d-70cfc631d047 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:25.379980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-171abd65-b52a-411d-8d9d-70cfc631d047 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:25.380614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-171abd65-b52a-411d-8d9d-70cfc631d047 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:25.462859 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-171abd65-b52a-411d-8d9d-70cfc631d047 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14 microversion: 2.1 time: 0.103873 Nov 16 16:16:25.464110 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 86/176] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:25 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:25.858242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:25.859369 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:25.867376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:25.868242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:25.869308 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:25.869953 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:25.877775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:16:25.878339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:16:25.881196 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:16:25.881632 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:16:25.882059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:16:25.894297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:25.895084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:25.896332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:25.897101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:25.918474 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Getting quotas for project ba4d0c4ca68d4ce0bb5542957d6c2874. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:16:25.923592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Getting quotas for user eea5bfe0bcfa4568986c6362ecfbe19d and project ba4d0c4ca68d4ce0bb5542957d6c2874. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:16:25.937631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:16:25.941068 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:16:26.004754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cde7adde-f376-428d-b85b-55ae6b0a0ab1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809302 Nov 16 16:16:26.016080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 91/177] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:16:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:16:26.029214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-67980cc0-b4ca-419f-8881-7bb0a192b7e5 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:26.032575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-67980cc0-b4ca-419f-8881-7bb0a192b7e5 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:26.181861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-67980cc0-b4ca-419f-8881-7bb0a192b7e5 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:26.205810 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-67980cc0-b4ca-419f-8881-7bb0a192b7e5 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1214 microversion: 2.1 time: 0.172802 Nov 16 16:16:26.217388 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 92/178] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:26 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1214 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:26.224442 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-71854f36-e8a3-499a-986a-c19453f6d409 req-27cb7a1d-8d0f-454d-ac25-ad0533a20373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b5a028c-3cac-418b-bf82-6171c049f94e", "tag": "4cd0124a-a76f-447f-ad3d-090da419460b"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:26.228509 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:26.228509 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:16:26.238083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-71854f36-e8a3-499a-986a-c19453f6d409 req-27cb7a1d-8d0f-454d-ac25-ad0533a20373 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:26.238863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-71854f36-e8a3-499a-986a-c19453f6d409 req-27cb7a1d-8d0f-454d-ac25-ad0533a20373 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:26.255019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-71854f36-e8a3-499a-986a-c19453f6d409 req-27cb7a1d-8d0f-454d-ac25-ad0533a20373 service nova] Creating event network-changed:4cd0124a-a76f-447f-ad3d-090da419460b for instance 5b5a028c-3cac-418b-bf82-6171c049f94e on hv-cinder-78776 Nov 16 16:16:26.260904 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-71854f36-e8a3-499a-986a-c19453f6d409 req-27cb7a1d-8d0f-454d-ac25-ad0533a20373 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041956 Nov 16 16:16:26.261498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 93/179] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:26.266138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:26.266867 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:26.274130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:26.274613 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:26.275419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:26.275862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:26.285979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:26.298554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-70cbc88f-827d-4503-b8d3-b750a24ac42b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.445476 Nov 16 16:16:26.301445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 87/180] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:25 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:26.373319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:26.374812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:26.391644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:26.392110 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:26.392918 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:26.393345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:26.686428 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:26.697898 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e62feba9-9bc5-4add-a791-18335b67cd17 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.434501 Nov 16 16:16:26.699072 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 94/181] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:26 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:26.707469 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f7e566e5-036e-445a-9f03-3486a880f1d3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:26.708805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f7e566e5-036e-445a-9f03-3486a880f1d3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:26.719102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7e566e5-036e-445a-9f03-3486a880f1d3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:26.719960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7e566e5-036e-445a-9f03-3486a880f1d3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:26.720851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7e566e5-036e-445a-9f03-3486a880f1d3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:26.721366 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7e566e5-036e-445a-9f03-3486a880f1d3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:26.789375 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:26.799089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-57c78e03-0383-4bca-8775-2cb7249fe452 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.429620 Nov 16 16:16:26.799870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 88/182] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:26 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:26.998467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f7e566e5-036e-445a-9f03-3486a880f1d3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 1298 microversion: 2.1 time: 0.297570 Nov 16 16:16:26.999818 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 95/183] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:26 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 1298 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:27.194108 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-5d65fe86-8757-44ca-a03f-a0fc66545215 req-75cb3bfc-21d8-4320-95bc-82740bc04e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "420506b0-61e6-4805-9ad2-8bff0d02a492", "tag": "c3148a2d-2ddf-47ae-bb9f-68eff80c86c5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:27.196318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:27.196318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:16:27.204493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-5d65fe86-8757-44ca-a03f-a0fc66545215 req-75cb3bfc-21d8-4320-95bc-82740bc04e10 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.205287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-5d65fe86-8757-44ca-a03f-a0fc66545215 req-75cb3bfc-21d8-4320-95bc-82740bc04e10 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.218539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-5d65fe86-8757-44ca-a03f-a0fc66545215 req-75cb3bfc-21d8-4320-95bc-82740bc04e10 service nova] Creating event network-changed:c3148a2d-2ddf-47ae-bb9f-68eff80c86c5 for instance 420506b0-61e6-4805-9ad2-8bff0d02a492 on hv-cinder-78776 Nov 16 16:16:27.225711 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:27.226427 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:27.237901 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.238350 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.239176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.239732 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.252098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-5d65fe86-8757-44ca-a03f-a0fc66545215 req-75cb3bfc-21d8-4320-95bc-82740bc04e10 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061421 Nov 16 16:16:27.252901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 89/184] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:27.319292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:27.320003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:27.326801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.327530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.328037 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:27.328438 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.328938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.336535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-15c6a0fe-1dad-41c1-8f72-5735dd654ef3 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1210 microversion: 2.1 time: 0.116381 Nov 16 16:16:27.337605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 96/185] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:27 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:27.610352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:27.617911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-44ba15c5-4022-4258-a25d-8f0efd6525ac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.302745 Nov 16 16:16:27.618498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 90/186] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:27 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:27.716610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:27.717295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:27.723974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.724550 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.725364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.725805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.816793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:27.817566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:27.824999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.824999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.825540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:27.826412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:27.937538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:27.946139 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-971d062c-dea5-423f-b3fb-3e9819b63f24 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.233469 Nov 16 16:16:27.946915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 97/187] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:27 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:28.009128 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-875ce7a4-b9cb-4ba8-b033-dfc5e65d33c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:28.010923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-875ce7a4-b9cb-4ba8-b033-dfc5e65d33c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:28.017039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-875ce7a4-b9cb-4ba8-b033-dfc5e65d33c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.017764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-875ce7a4-b9cb-4ba8-b033-dfc5e65d33c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:28.018779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-875ce7a4-b9cb-4ba8-b033-dfc5e65d33c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.019433 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-875ce7a4-b9cb-4ba8-b033-dfc5e65d33c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:28.098498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:28.107659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7a3b2010-4eb1-4c28-bb9a-0f3b5501701d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.294713 Nov 16 16:16:28.108926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 91/188] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:27 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:28.262176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-875ce7a4-b9cb-4ba8-b033-dfc5e65d33c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 7493 microversion: 2.1 time: 0.256543 Nov 16 16:16:28.263072 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 98/189] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:28 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 7493 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:28.362224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:28.362954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:28.374464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.374999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:28.375854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.376374 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:28.494312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:28.503260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-98e6ab7b-9c5a-4ed1-ba62-b4ee372f3b76 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1272 microversion: 2.1 time: 0.150944 Nov 16 16:16:28.504339 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 92/190] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:28 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:28.636664 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:28.638881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:28.647578 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.657415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:28.658279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.658792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:28.811192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:28.818791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-591ba791-d4e1-403f-8600-4f126a49e5b6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.186850 Nov 16 16:16:28.819347 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 99/191] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:28 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:28.964522 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:28.965119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:28.972627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.973097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:28.973868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:28.974293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.116034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:29.124152 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-39bd668e-6199-4c9b-9371-c8a7f7739b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.164017 Nov 16 16:16:29.124718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 93/192] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:28 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:29.133710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:29.133710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:29.133710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.133710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.134594 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.134594 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.273175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b6c81d7c-9149-44d0-8f8a-05a664712248 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:29.275074 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b6c81d7c-9149-44d0-8f8a-05a664712248 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:29.279201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:29.282062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b6c81d7c-9149-44d0-8f8a-05a664712248 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.282606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b6c81d7c-9149-44d0-8f8a-05a664712248 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.283646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b6c81d7c-9149-44d0-8f8a-05a664712248 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.284149 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b6c81d7c-9149-44d0-8f8a-05a664712248 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.287232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-10ec57f4-fc7f-4178-8752-0b417810321d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.166034 Nov 16 16:16:29.288298 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 100/193] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:29 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:29.418614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b6c81d7c-9149-44d0-8f8a-05a664712248 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 11155 microversion: 2.1 time: 0.149050 Nov 16 16:16:29.419477 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-d62c48d4-9cef-4e87-871e-56e74d1e879c req-8170b9cc-51e2-4ee8-b08e-abedb6e8cfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d694467-d767-4cab-9f05-480b3d073de6", "tag": "6feab9d3-3675-4ea3-b182-74c25d647b73"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:29.419621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 94/194] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:29 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 11155 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:16:29.421289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:29.421289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:16:29.430215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-d62c48d4-9cef-4e87-871e-56e74d1e879c req-8170b9cc-51e2-4ee8-b08e-abedb6e8cfa9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.430802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-d62c48d4-9cef-4e87-871e-56e74d1e879c req-8170b9cc-51e2-4ee8-b08e-abedb6e8cfa9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.443707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-d62c48d4-9cef-4e87-871e-56e74d1e879c req-8170b9cc-51e2-4ee8-b08e-abedb6e8cfa9 service nova] Creating event network-changed:6feab9d3-3675-4ea3-b182-74c25d647b73 for instance 6d694467-d767-4cab-9f05-480b3d073de6 on hv-cinder-78776 Nov 16 16:16:29.447964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-d62c48d4-9cef-4e87-871e-56e74d1e879c req-8170b9cc-51e2-4ee8-b08e-abedb6e8cfa9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032235 Nov 16 16:16:29.448557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 101/195] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:29.521724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:29.522615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:29.529769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.530223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.531036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.531472 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.681944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:29.689827 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-270987d8-63ab-4c87-9fa4-7835abcd65fb tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.172050 Nov 16 16:16:29.694430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 95/196] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:29 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:29.837577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:29.838876 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:29.846210 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.847038 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:29.847911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:29.848443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.047486 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:30.056895 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8cf488f0-d1a9-4175-86e1-fb1f4bb2097e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.224536 Nov 16 16:16:30.058515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 102/197] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:29 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:30.141807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:30.142809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:30.150436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.151310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.152138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.152565 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.284302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:30.293452 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7fde1de3-5fb8-4b26-bff4-8312b187123c tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.155502 Nov 16 16:16:30.294028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 96/198] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:30 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:30.304949 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:30.305557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:30.311926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.312464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.313376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.313878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.432932 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9dcc517a-b96c-4033-9cd0-f52050c728a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:30.434120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9dcc517a-b96c-4033-9cd0-f52050c728a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:30.441049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9dcc517a-b96c-4033-9cd0-f52050c728a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.441495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9dcc517a-b96c-4033-9cd0-f52050c728a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.442326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9dcc517a-b96c-4033-9cd0-f52050c728a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.442779 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9dcc517a-b96c-4033-9cd0-f52050c728a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.538028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9dcc517a-b96c-4033-9cd0-f52050c728a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 14352 microversion: 2.1 time: 0.111614 Nov 16 16:16:30.539641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 97/199] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:30 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 14352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:30.668959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:30.676709 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9cdc9c11-6561-4657-80b7-b4719bb963c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.375550 Nov 16 16:16:30.677266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 103/200] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:30 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:30.708007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:30.708687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:30.716081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.716521 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.717300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:30.717733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:30.862818 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:30.870665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-221c3c04-c883-4d7b-8881-2b0f853f9d2d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.166656 Nov 16 16:16:30.871214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 98/201] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:30 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:31.077371 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:31.078117 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:31.086938 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.087478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.088418 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.088926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.229879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:31.238315 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3c0cc36f-6005-4719-8a68-f4006c1a0868 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.165663 Nov 16 16:16:31.239167 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 104/202] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:31 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:31.314078 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:31.315139 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:31.324034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.324469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.325234 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.325910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.458977 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:31.467113 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-136eb455-3e9a-4ed6-964b-dde675ec1143 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.159171 Nov 16 16:16:31.467837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 99/203] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:31 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:31.554050 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dc881a1c-776e-480c-8716-ed592e1c9d74 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:31.555406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dc881a1c-776e-480c-8716-ed592e1c9d74 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:31.561552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc881a1c-776e-480c-8716-ed592e1c9d74 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.561989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc881a1c-776e-480c-8716-ed592e1c9d74 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.562802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc881a1c-776e-480c-8716-ed592e1c9d74 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.563233 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc881a1c-776e-480c-8716-ed592e1c9d74 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.695341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:31.695771 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:31.703476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.703950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.704841 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.705270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.771358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dc881a1c-776e-480c-8716-ed592e1c9d74 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 16486 microversion: 2.1 time: 0.223369 Nov 16 16:16:31.772021 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 105/204] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:31 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 16486 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:31.844630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:31.852558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c2add7f8-8a09-4487-9db4-ee218cbb00d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.161220 Nov 16 16:16:31.853122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 100/205] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:31 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:31.888317 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:31.889027 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:31.896286 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.896734 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:31.897511 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:31.897954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.038707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:32.046537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-029a07ad-bf55-4052-95dd-1e67f0502e4b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.162331 Nov 16 16:16:32.047327 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 106/206] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:31 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:32.256072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:32.256690 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:32.263566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.264031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.264766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.265191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.426395 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:32.434358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-524d0187-0dd7-4446-a78a-2e063a1d9f48 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.181911 Nov 16 16:16:32.435296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 101/207] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:32 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:32.485421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:32.486293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:32.494705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.495085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.495846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.496269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.632855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:32.640957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-02dd22c0-0866-4806-980f-07c3afcf81b9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.159710 Nov 16 16:16:32.641506 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 107/208] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:32 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:32.787819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-35833d2f-a15f-402b-9e4f-cf41884b8583 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:32.789378 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-35833d2f-a15f-402b-9e4f-cf41884b8583 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:32.796802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35833d2f-a15f-402b-9e4f-cf41884b8583 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.797502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35833d2f-a15f-402b-9e4f-cf41884b8583 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.798842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35833d2f-a15f-402b-9e4f-cf41884b8583 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.799457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35833d2f-a15f-402b-9e4f-cf41884b8583 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.869009 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:32.869611 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:32.876494 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.876945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.877719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.878175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.934810 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-35833d2f-a15f-402b-9e4f-cf41884b8583 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 17602 microversion: 2.1 time: 0.153118 Nov 16 16:16:32.935683 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 102/209] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:32 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 17602 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:32.954261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:32.954877 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:32.961886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.962332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.963138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:32.963758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:32.989729 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:16:33.010021 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:33.017860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b9d02f5d-8aa8-4e88-82a9-b972b5ee55ee tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.152499 Nov 16 16:16:33.018515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 108/210] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:32 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:33.063947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:33.064644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:33.071521 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.071973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.072761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.073236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.090533 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-586271c2-30b5-4e76-bdc5-e1510d4b060f tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "DELETE /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 204 len: 0 microversion: 2.1 time: 0.139797 Nov 16 16:16:33.091131 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 103/211] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:16:32 2021] DELETE /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:16:33.100682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:33.101428 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:33.111288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.111725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.112491 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.112929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.284048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:33.292223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2ae1853a-f384-4814-a81b-5c867fad9e92 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.232670 Nov 16 16:16:33.292860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 109/212] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:33 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:33.295947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:33.304240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-61efa5e2-d17d-45bd-9b9b-2091048c71fa tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.208289 Nov 16 16:16:33.305001 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 104/213] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:33 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:33.452530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:33.457130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:33.460366 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.460826 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.461680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.462080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.616838 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:33.628320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9e3ac525-32f4-467b-9272-885fce6edae4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.180035 Nov 16 16:16:33.629128 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 110/214] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:33 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:33.658281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:33.659025 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:33.665952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.666420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.667155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.667581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.805720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:33.813847 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e0e5b00a-41fa-4059-8b3c-58f415ef2898 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.159269 Nov 16 16:16:33.814404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 105/215] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:33 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:33.950716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7077148e-65cb-428c-bb7d-842cd1a7e5f9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:33.952175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7077148e-65cb-428c-bb7d-842cd1a7e5f9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:33.961973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7077148e-65cb-428c-bb7d-842cd1a7e5f9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.962475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7077148e-65cb-428c-bb7d-842cd1a7e5f9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:33.963262 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7077148e-65cb-428c-bb7d-842cd1a7e5f9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:33.963735 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7077148e-65cb-428c-bb7d-842cd1a7e5f9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.035490 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:34.036092 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:34.042506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.042958 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.043740 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.044174 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.185771 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:34.193313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a978ca0c-84b7-4587-a279-db6296ae27eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.161516 Nov 16 16:16:34.193910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 106/216] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:34 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:34.315829 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:34.316944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:34.327071 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.327677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.328834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.329411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.478720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:34.486793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-34145731-a95f-497b-881a-b50330b15bf4 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.179639 Nov 16 16:16:34.487376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 107/217] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:34 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:34.491694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:34.492468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:34.498579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.499031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.499882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.500318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.646985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:34.656070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-724128c8-bac4-4e48-a280-96ab99222044 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.167705 Nov 16 16:16:34.656628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 108/218] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:34 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:34.660800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:34.661471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:34.668489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.668922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.669680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.670106 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.804952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:34.814968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-dc50d699-c2be-47f6-b0f0-5b1ad8217938 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.157341 Nov 16 16:16:34.815555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 109/219] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:34 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:34.836218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:34.836818 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:34.843130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.843608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.844376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:34.844807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:34.983690 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:34.991072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-30de81c6-6a20-4adf-bbe4-8790abc47be8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.158464 Nov 16 16:16:34.991639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 110/220] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:34 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:35.211175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:35.211838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:35.217921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.218350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.219182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.219619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.349595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:35.357742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-802cc3ef-e040-47de-94d3-be9ffb0f080e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.150582 Nov 16 16:16:35.358320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 111/221] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:35 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:35.503985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:35.505083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:35.515328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.515992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.517105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.517698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.661050 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:35.670041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e897b41f-9394-4c3f-885b-99a37a03956b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.170181 Nov 16 16:16:35.670644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 112/222] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:35 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:35.674908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:35.675643 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:35.681845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.682293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.683097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.683525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.825007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:35.833735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5ced288e-36c2-400b-bd35-12c5821e8f6b tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.162119 Nov 16 16:16:35.834310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 113/223] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:35 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:35.839091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:35.839687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:35.845667 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.846114 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.846931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:35.847363 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:35.982882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:35.994217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-85206097-28c4-4529-975c-e654133f5f16 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.158928 Nov 16 16:16:35.994808 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 114/224] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:35 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:36.009584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:36.010403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:36.018985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.019578 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:36.020736 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.021320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:36.161402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:36.169105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8f7643c8-69ad-440a-8846-0954b5e6f56a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.164701 Nov 16 16:16:36.169670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 115/225] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:36 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:36.378168 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:36.379309 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:36.387457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.387764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:36.388555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.389004 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:36.537687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:36.545699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ac971f6f-6e2c-47dc-9b6f-20b242573ba1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.173347 Nov 16 16:16:36.546170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 116/226] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:36 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:36.686903 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:36.687550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:36.694311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.694784 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:36.695567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.696020 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:36.840159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:36.848007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8f471080-65af-4f1f-bb36-2bf9d91bbc5b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.164771 Nov 16 16:16:36.848574 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 117/227] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:36 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:36.853082 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:36.853702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:36.859663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.860108 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:36.860881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:36.861314 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.002062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:37.013717 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0cb97a3f-3b1e-4661-96ea-43e671135f31 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.163878 Nov 16 16:16:37.014530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 118/228] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:36 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:37.019104 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:37.019700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:37.026222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.026691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.027459 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.027880 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.179690 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:37.190253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-62aff975-b25a-4d90-bc29-61ea4e452160 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.174323 Nov 16 16:16:37.191055 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 119/229] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:37 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:37.195377 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:37.196061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:37.201884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.202322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.203126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.203559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.339480 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:37.350911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-017e21da-7cdb-4397-98e2-6fcc407ddb80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.158552 Nov 16 16:16:37.351783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 120/230] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:37 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:37.562711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:37.563319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:37.569761 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.570198 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.571036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.571494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.716601 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:37.724041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fed81348-0ae2-40f4-8747-9fb68a44b330 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.165022 Nov 16 16:16:37.724605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 121/231] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:37 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:37.830908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-e6fe88d0-8262-4725-afa2-40f35c2d7bc0 req-4ef2854e-8f81-4e1a-bae3-53008eee10b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5a028c-3cac-418b-bf82-6171c049f94e", "name": "network-vif-plugged", "status": "completed", "tag": "4cd0124a-a76f-447f-ad3d-090da419460b"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:37.832798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:37.832798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:16:37.841620 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e6fe88d0-8262-4725-afa2-40f35c2d7bc0 req-4ef2854e-8f81-4e1a-bae3-53008eee10b8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.842064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e6fe88d0-8262-4725-afa2-40f35c2d7bc0 req-4ef2854e-8f81-4e1a-bae3-53008eee10b8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.859433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-e6fe88d0-8262-4725-afa2-40f35c2d7bc0 req-4ef2854e-8f81-4e1a-bae3-53008eee10b8 service nova] Creating event network-vif-plugged:4cd0124a-a76f-447f-ad3d-090da419460b for instance 5b5a028c-3cac-418b-bf82-6171c049f94e on hv-cinder-78776 Nov 16 16:16:37.862165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-e6fe88d0-8262-4725-afa2-40f35c2d7bc0 req-4ef2854e-8f81-4e1a-bae3-53008eee10b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Nov 16 16:16:37.862943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 122/232] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:37.867972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:37.868694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:37.875008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.875464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:37.876241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:37.876666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.015457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:38.026064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-623a0c98-7dd3-442c-bac3-89b99cb0cd3d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.161947 Nov 16 16:16:38.026657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 123/233] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:37 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:38.032734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:38.033554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:38.042132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.042613 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.043388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.043812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.187949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:38.201141 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-072684d4-e273-4ad2-be58-d7184cb720e0 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.173090 Nov 16 16:16:38.202053 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 124/234] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:38 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:38.212286 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:38.212928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:38.219348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.219809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.220575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.221006 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.358117 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:38.366061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c1c9a7ef-8d5e-4dc8-8419-a9faa8022ba9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.161007 Nov 16 16:16:38.366648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 125/235] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:38 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:38.371889 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:38.372483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:38.378651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.379225 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.379995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.380424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.528758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:38.536615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5545687a-73b5-4edf-8656-b66446bf7301 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.168504 Nov 16 16:16:38.537192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 126/236] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:38 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:38.741099 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:38.741725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:38.748223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.748669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.749451 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:38.749881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:38.889247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:38.900805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-62fee244-8f2c-465b-8103-73438a9e00a4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.163478 Nov 16 16:16:38.901395 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 127/237] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:38 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:39.052013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:39.053466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:39.062057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.062539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.063311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.063746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.217872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:39.227036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8ebf9ad1-9f6f-4913-b9bf-7c8e91251ded tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.181323 Nov 16 16:16:39.228041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 128/238] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:39 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:39.232537 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:39.233129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:39.235246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7077148e-65cb-428c-bb7d-842cd1a7e5f9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 24254 microversion: 2.1 time: 5.290744 Nov 16 16:16:39.236276 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 111/239] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:33 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 24254 bytes in 5293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:39.239901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.240360 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.241180 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.241612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.377581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:39.383775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:39.384495 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:39.386218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-39e47f86-6bb4-4c0c-82af-e1492dc5d130 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.157181 Nov 16 16:16:39.386816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 129/240] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:39 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:39.391079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.391523 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.392294 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.392719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.530363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:39.538167 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1a94e6a8-a2aa-4b96-be22-30b2c1af486e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.158850 Nov 16 16:16:39.538783 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 112/241] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:39 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:39.553219 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:39.553892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:39.560327 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.560702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.561463 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.561885 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.699969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:39.708999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-312b41de-a653-4423-ae55-0d6ff1601088 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.159513 Nov 16 16:16:39.709563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 130/242] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:39 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:39.925906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:39.926770 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:39.935037 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.935478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:39.936238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:39.936665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.087718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:40.095265 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1ae63456-7015-4704-bc62-31ef878bc325 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.175125 Nov 16 16:16:40.095793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 113/243] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:39 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:40.249603 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:40.250664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:40.250892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7b0c6599-22cd-4d10-907a-18297d08333c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:40.252348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7b0c6599-22cd-4d10-907a-18297d08333c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:40.260673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.261113 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.261446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b0c6599-22cd-4d10-907a-18297d08333c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.261881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.262046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b0c6599-22cd-4d10-907a-18297d08333c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.262595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.262791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b0c6599-22cd-4d10-907a-18297d08333c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.263098 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b0c6599-22cd-4d10-907a-18297d08333c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.398515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:40.406335 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1ff0a22d-1c4a-4d37-a993-79f557e0bad7 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.163238 Nov 16 16:16:40.406945 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 131/244] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:40 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:40.411282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:40.411877 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:40.418324 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.418797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.419567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.419999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.463097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7b0c6599-22cd-4d10-907a-18297d08333c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 24806 microversion: 2.1 time: 0.218448 Nov 16 16:16:40.463717 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 114/245] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:40 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 24806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:40.557364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:40.558121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:40.561158 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:40.565975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.566420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.567220 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.567639 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.569452 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8991a28f-0c40-4797-a0f0-01999b7acf32 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.161565 Nov 16 16:16:40.570040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 132/246] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:40 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:40.710549 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:40.718232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b68f59ac-467b-4368-8a20-cd28bf1a5b28 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.165919 Nov 16 16:16:40.718925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 115/247] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:40 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:40.730043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:40.730817 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:40.736926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.737437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.738227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:40.738678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:40.879503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:40.887066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-37b9aa98-8139-4c82-85b1-6e9f90d65d4f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.160873 Nov 16 16:16:40.887720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 133/248] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:40 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:41.115803 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:41.116571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:41.125446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.125985 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.126980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.127511 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.267377 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:41.279247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55ec339e-c6b7-4630-aa9a-d1f191c66b28 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.167702 Nov 16 16:16:41.279901 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 116/249] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:41 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:41.422721 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:41.423312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:41.430113 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.431091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.431872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.432301 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.477668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-74bf0101-2bb4-49fe-9dc0-b622cbfc721c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:41.477668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-74bf0101-2bb4-49fe-9dc0-b622cbfc721c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:41.487286 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74bf0101-2bb4-49fe-9dc0-b622cbfc721c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.487934 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74bf0101-2bb4-49fe-9dc0-b622cbfc721c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.489136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74bf0101-2bb4-49fe-9dc0-b622cbfc721c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.489760 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-74bf0101-2bb4-49fe-9dc0-b622cbfc721c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.574065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:41.581469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ec614eb6-fc05-42fe-bdeb-b9a261b33635 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.162470 Nov 16 16:16:41.582242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 134/250] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:41 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:41.592776 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:41.593427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:41.599669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.600081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-74bf0101-2bb4-49fe-9dc0-b622cbfc721c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 25738 microversion: 2.1 time: 0.128263 Nov 16 16:16:41.600227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.601166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.601283 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 117/251] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:41 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 25738 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:41.601373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.735165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-8201c056-2882-4c89-8499-cce8b073a753 req-33285fa8-7ba7-466c-b806-81937e063421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420506b0-61e6-4805-9ad2-8bff0d02a492", "name": "network-vif-plugged", "status": "completed", "tag": "c3148a2d-2ddf-47ae-bb9f-68eff80c86c5"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:41.736635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:41.736635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:16:41.739793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:41.746568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8201c056-2882-4c89-8499-cce8b073a753 req-33285fa8-7ba7-466c-b806-81937e063421 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.746996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8201c056-2882-4c89-8499-cce8b073a753 req-33285fa8-7ba7-466c-b806-81937e063421 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.750212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3f9ca4d5-b706-4746-9ea0-533cb79e9d64 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.160915 Nov 16 16:16:41.761254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 135/252] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:41 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:41.761254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:41.761254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:41.761845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.762291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.763215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.763818 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.765062 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-8201c056-2882-4c89-8499-cce8b073a753 req-33285fa8-7ba7-466c-b806-81937e063421 service nova] Creating event network-vif-plugged:c3148a2d-2ddf-47ae-bb9f-68eff80c86c5 for instance 420506b0-61e6-4805-9ad2-8bff0d02a492 on hv-cinder-78776 Nov 16 16:16:41.769989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-8201c056-2882-4c89-8499-cce8b073a753 req-33285fa8-7ba7-466c-b806-81937e063421 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039174 Nov 16 16:16:41.770810 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 118/253] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:41.906716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:41.907906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:41.910137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:41.914935 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.915569 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.916491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:41.917079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:41.917943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b99ff134-8ec5-408f-8bc5-5047d3a9bd99 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.166129 Nov 16 16:16:41.918548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 136/254] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:41 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:42.065925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:42.073623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4bf91a57-3350-4950-87f6-45f9431f2e0f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1318 microversion: 2.1 time: 0.172477 Nov 16 16:16:42.074282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 119/255] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:41 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:42.297355 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:42.297937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:42.305932 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.306951 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.308126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.308697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.452572 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:42.460811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b4c732e1-e112-432f-92aa-f3e345056ac6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.167229 Nov 16 16:16:42.461434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 137/256] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:42 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:42.597960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:42.598583 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:42.605216 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.605681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.606638 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.607380 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.612181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d1e6d171-6b23-4bd7-adf9-32192cba0aa6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:42.613215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d1e6d171-6b23-4bd7-adf9-32192cba0aa6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:42.619213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e6d171-6b23-4bd7-adf9-32192cba0aa6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.619658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e6d171-6b23-4bd7-adf9-32192cba0aa6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.620436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e6d171-6b23-4bd7-adf9-32192cba0aa6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.620866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e6d171-6b23-4bd7-adf9-32192cba0aa6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.741756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:42.750031 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7ea8684f-e31d-43a6-9de9-1635a45f0f87 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.155882 Nov 16 16:16:42.750683 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 120/257] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:42 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:42.761265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d1e6d171-6b23-4bd7-adf9-32192cba0aa6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 26315 microversion: 2.1 time: 0.152584 Nov 16 16:16:42.761878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 138/258] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:42 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 26315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:16:42.768438 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:42.769048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:42.775960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.776408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.777191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.777646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.916792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:42.924787 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-82296cee-8ac7-455e-95ee-1cdf11f6ea27 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.159992 Nov 16 16:16:42.925363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 121/259] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:42 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:42.935285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:42.935978 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:42.942887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.943331 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:42.944102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:42.944530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.086681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:43.091142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:43.091747 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:43.094276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bc8fc721-bf89-406f-b344-b8e28d6ef8a0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.162953 Nov 16 16:16:43.094851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 139/260] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:42 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:43.097946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.098425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.099198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.099657 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.243026 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:43.254977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e2b505a5-6124-414a-b807-4eb62e1d7299 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1506 microversion: 2.1 time: 0.167424 Nov 16 16:16:43.255852 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 122/261] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:43 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:43.476990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:43.477741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:43.485123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.487017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.489619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.490749 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.658500 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:43.671658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-99c5df58-6fd1-4f57-bb60-370e032f278a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.198169 Nov 16 16:16:43.673182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 140/262] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:43 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:43.768027 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:43.770309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:43.773437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c3b30688-4367-49a5-9bf4-74a68efa0df8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:43.775376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c3b30688-4367-49a5-9bf4-74a68efa0df8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:43.785581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3b30688-4367-49a5-9bf4-74a68efa0df8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.786037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3b30688-4367-49a5-9bf4-74a68efa0df8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.794558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.796153 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.798114 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3b30688-4367-49a5-9bf4-74a68efa0df8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.798602 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c3b30688-4367-49a5-9bf4-74a68efa0df8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.798939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.800403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.903941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c3b30688-4367-49a5-9bf4-74a68efa0df8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 27068 microversion: 2.1 time: 0.134549 Nov 16 16:16:43.904780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 141/263] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:43 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 27068 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:43.940073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-83ce6465-8ba1-4793-975e-11192f4def8c req-93967781-5eaf-44b7-a0b1-a5a8426221cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d694467-d767-4cab-9f05-480b3d073de6", "name": "network-vif-plugged", "status": "completed", "tag": "6feab9d3-3675-4ea3-b182-74c25d647b73"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:43.942156 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:43.942156 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:16:43.959471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-83ce6465-8ba1-4793-975e-11192f4def8c req-93967781-5eaf-44b7-a0b1-a5a8426221cc service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:43.963930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-83ce6465-8ba1-4793-975e-11192f4def8c req-93967781-5eaf-44b7-a0b1-a5a8426221cc service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:43.993245 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-83ce6465-8ba1-4793-975e-11192f4def8c req-93967781-5eaf-44b7-a0b1-a5a8426221cc service nova] Creating event network-vif-plugged:6feab9d3-3675-4ea3-b182-74c25d647b73 for instance 6d694467-d767-4cab-9f05-480b3d073de6 on hv-cinder-78776 Nov 16 16:16:44.005984 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-83ce6465-8ba1-4793-975e-11192f4def8c req-93967781-5eaf-44b7-a0b1-a5a8426221cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071415 Nov 16 16:16:44.007146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 142/264] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:44.012571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:44.019652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:44.043079 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.043907 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.045030 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.045670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.124445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:44.137793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2525d17f-149f-4b48-bd80-2ff40f76c830 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.371676 Nov 16 16:16:44.151660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 123/265] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:43 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:44.164307 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:44.167171 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:44.184974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.185791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.189929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.191425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.426684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:44.437341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3a33dcd3-3e14-4d48-9359-acda7c079b7c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1553 microversion: 2.1 time: 0.428783 Nov 16 16:16:44.438695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 143/266] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:44 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1553 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:44.522853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:44.533232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-85337181-c7c7-4198-96c1-c3612bcff443 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1318 microversion: 2.1 time: 0.377355 Nov 16 16:16:44.534565 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 124/267] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:44 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:44.578640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-8ac1f26d-33e6-4775-b65d-e8c9fc52cd10 req-e09d7d7e-676c-47e6-92e5-2276ab433100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404a11e5-c791-46cd-b455-ef6eca512695", "name": "network-vif-deleted", "tag": "47508073-20f8-411c-b5ec-1fee3ead99b0"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:44.580315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:44.580315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:16:44.588120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-8ac1f26d-33e6-4775-b65d-e8c9fc52cd10 req-e09d7d7e-676c-47e6-92e5-2276ab433100 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.588559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-8ac1f26d-33e6-4775-b65d-e8c9fc52cd10 req-e09d7d7e-676c-47e6-92e5-2276ab433100 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.599380 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-8ac1f26d-33e6-4775-b65d-e8c9fc52cd10 req-e09d7d7e-676c-47e6-92e5-2276ab433100 service nova] Creating event network-vif-deleted:47508073-20f8-411c-b5ec-1fee3ead99b0 for instance 404a11e5-c791-46cd-b455-ef6eca512695 on hv-cinder-78776 Nov 16 16:16:44.604997 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-8ac1f26d-33e6-4775-b65d-e8c9fc52cd10 req-e09d7d7e-676c-47e6-92e5-2276ab433100 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030402 Nov 16 16:16:44.605609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 144/268] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:44.689067 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:44.689862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:44.695704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.696287 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.697200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.697705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.858932 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:44.868367 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9b14838a-9e90-4492-a594-6a50f2ebbd21 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.182677 Nov 16 16:16:44.869339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 125/269] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:44 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:44.916850 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-78497c84-4e8c-4117-976c-9acb4ec482f8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:44.918716 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-78497c84-4e8c-4117-976c-9acb4ec482f8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:44.925687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78497c84-4e8c-4117-976c-9acb4ec482f8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.926394 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78497c84-4e8c-4117-976c-9acb4ec482f8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:44.927354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78497c84-4e8c-4117-976c-9acb4ec482f8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:44.927634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78497c84-4e8c-4117-976c-9acb4ec482f8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.033012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-78497c84-4e8c-4117-976c-9acb4ec482f8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 27665 microversion: 2.1 time: 0.120598 Nov 16 16:16:45.033752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 145/270] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:44 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 27665 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:45.157345 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:45.158031 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:45.164270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.164774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.165764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.166167 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.388377 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:45.395812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9f9cf3ff-0619-4ce9-8b09-9011fd14f529 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.242416 Nov 16 16:16:45.396382 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 126/271] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:45 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:45.456123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:45.456998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:45.465305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.465824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.466986 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.467581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.541268 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd24fd836e181415e976fbd3d41d7dd14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990dd2b2c59e48e595895701e1347ea5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:45.551376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:45.552012 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:45.556329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d9c4888e-aeff-4f5a-8aae-ce68794c4062 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 200 len: 1346 microversion: 2.1 time: 0.103243 Nov 16 16:16:45.556919 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 146/272] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:45 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 1346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:45.558867 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.559323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.560124 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.560554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.708825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:45.716481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-97bd5004-9a2e-427d-af9d-b7c857e76471 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1508 microversion: 2.1 time: 0.168853 Nov 16 16:16:45.717052 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 127/273] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:45 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:45.733206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7af89d6f-4351-4a99-80ee-ffe57f7cf193"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:45.734260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:45.740624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.741096 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.741866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.742320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.824694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] HTTP exception thrown: Invalid volume: volume 7af89d6f-4351-4a99-80ee-ffe57f7cf193 is already attached to instances: cc4a1e6e-5d38-4c3e-8381-112022eb6207 Nov 16 16:16:45.825360 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Returning 400 to user: Invalid volume: volume 7af89d6f-4351-4a99-80ee-ffe57f7cf193 is already attached to instances: cc4a1e6e-5d38-4c3e-8381-112022eb6207 {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:16:45.826208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-21d6697d-44e8-495b-93db-fa83816aa22f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097116 Nov 16 16:16:45.826783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 147/274] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:16:45 2021] POST /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:16:45.885889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:45.886542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:45.888777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:45.890202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:45.894634 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.895339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.896280 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.896868 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.901103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.901748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:45.902783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:45.903396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.059742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:46.071011 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bfde0f04-df38-446a-abb9-d9ed684b63ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.185918 Nov 16 16:16:46.071558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lazy-loading 'services' on Instance uuid cc4a1e6e-5d38-4c3e-8381-112022eb6207 {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:16:46.081291 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 128/275] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:45 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:46.088824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5ae3c463-78c8-4c99-9004-c9508561a388 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:46.090556 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5ae3c463-78c8-4c99-9004-c9508561a388 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:46.097466 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ae3c463-78c8-4c99-9004-c9508561a388 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.098079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ae3c463-78c8-4c99-9004-c9508561a388 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.099063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ae3c463-78c8-4c99-9004-c9508561a388 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.099512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ae3c463-78c8-4c99-9004-c9508561a388 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.238045 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5ae3c463-78c8-4c99-9004-c9508561a388 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 27796 microversion: 2.1 time: 0.155294 Nov 16 16:16:46.239727 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 129/276] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:46 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 27796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:46.245092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-57699bb8-f0fd-4662-a306-b204c934f8f9 req-cc1ae393-b2be-40a3-88f6-a1051390e306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404a11e5-c791-46cd-b455-ef6eca512695", "name": "network-vif-unplugged", "status": "completed", "tag": "47508073-20f8-411c-b5ec-1fee3ead99b0"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:46.246920 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:46.246920 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:16:46.254285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-038d1abb-5457-4617-8609-5d88b806da87 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments/7af89d6f-4351-4a99-80ee-ffe57f7cf193" status: 202 len: 0 microversion: 2.1 time: 0.371686 Nov 16 16:16:46.258229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 148/277] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:16:45 2021] DELETE /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments/7af89d6f-4351-4a99-80ee-ffe57f7cf193 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:16:46.259226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-57699bb8-f0fd-4662-a306-b204c934f8f9 req-cc1ae393-b2be-40a3-88f6-a1051390e306 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.259764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-57699bb8-f0fd-4662-a306-b204c934f8f9 req-cc1ae393-b2be-40a3-88f6-a1051390e306 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.264544 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fc76c484-c5c1-4b39-88db-f3cd668752ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:46.265836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fc76c484-c5c1-4b39-88db-f3cd668752ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:46.271759 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-57699bb8-f0fd-4662-a306-b204c934f8f9 req-cc1ae393-b2be-40a3-88f6-a1051390e306 service nova] Creating event network-vif-unplugged:47508073-20f8-411c-b5ec-1fee3ead99b0 for instance 404a11e5-c791-46cd-b455-ef6eca512695 on hv-cinder-78776 Nov 16 16:16:46.273978 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc76c484-c5c1-4b39-88db-f3cd668752ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.274464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc76c484-c5c1-4b39-88db-f3cd668752ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.275464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc76c484-c5c1-4b39-88db-f3cd668752ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.275948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc76c484-c5c1-4b39-88db-f3cd668752ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.297087 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-57699bb8-f0fd-4662-a306-b204c934f8f9 req-cc1ae393-b2be-40a3-88f6-a1051390e306 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049340 Nov 16 16:16:46.297995 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 130/278] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:46.312183 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fc76c484-c5c1-4b39-88db-f3cd668752ef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052159 Nov 16 16:16:46.312988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 149/279] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:16:46 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:46.413776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:46.414525 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:46.420973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.421420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.422198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.422819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.573390 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:46.574714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:46.590925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:46.597645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.598472 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.599502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.599911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-89739dd2-5501-4662-b3ac-e54ec30561fc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1314 microversion: 2.1 time: 0.190549 Nov 16 16:16:46.600320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.600520 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 131/280] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:46 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:46.616474 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] HTTP exception thrown: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. Nov 16 16:16:46.617446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Returning 404 to user: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:16:46.618637 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d1e7fe9d-0c0a-407b-88c7-baf30c06c42d tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 404 len: 111 microversion: 2.1 time: 0.049515 Nov 16 16:16:46.620144 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 150/281] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:46 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:16:46.733297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:46.734304 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:46.741509 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.741806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.742819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:46.743247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:46.756092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] HTTP exception thrown: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. Nov 16 16:16:46.756675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Returning 404 to user: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:16:46.757584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-666cf75f-82bf-48d0-8f9a-2994fb58824e tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028484 Nov 16 16:16:46.758092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 132/282] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:16:46 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:16:47.088769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:47.089260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:47.096606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.097072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.098130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.098620 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.249914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:47.251085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a8f7c971-d404-4501-866d-0f5627b112f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:47.253704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a8f7c971-d404-4501-866d-0f5627b112f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:47.257994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f9a34f82-d9ed-43e4-abc4-8375d8cd1c82 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.173256 Nov 16 16:16:47.265979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8f7c971-d404-4501-866d-0f5627b112f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.266457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8f7c971-d404-4501-866d-0f5627b112f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.267309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8f7c971-d404-4501-866d-0f5627b112f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.267742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8f7c971-d404-4501-866d-0f5627b112f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.268731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 151/283] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:47 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:47.324404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0515969d-694d-444c-aee6-aa7ab9f0b4a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:47.325328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0515969d-694d-444c-aee6-aa7ab9f0b4a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:47.331386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0515969d-694d-444c-aee6-aa7ab9f0b4a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.331827 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0515969d-694d-444c-aee6-aa7ab9f0b4a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.332605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0515969d-694d-444c-aee6-aa7ab9f0b4a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.333016 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0515969d-694d-444c-aee6-aa7ab9f0b4a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.364632 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0515969d-694d-444c-aee6-aa7ab9f0b4a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Nov 16 16:16:47.365199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 152/284] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:16:47 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:47.375092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a8f7c971-d404-4501-866d-0f5627b112f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 27808 microversion: 2.1 time: 0.127896 Nov 16 16:16:47.379368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 133/285] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:47 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 27808 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:16:47.617143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:47.617911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:47.624587 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.625115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.625939 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.626612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.776349 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:47.784187 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a15ecb7e-7de3-42a1-a052-ca5958a9504d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1499 microversion: 2.1 time: 0.170684 Nov 16 16:16:47.784770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 153/286] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:47 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1499 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:47.955633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:47.956264 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:47.963964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.964568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.965886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:47.966666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:47.983882 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] HTTP exception thrown: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. Nov 16 16:16:47.984777 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Returning 404 to user: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:16:47.985941 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5ee741a3-d8f1-4105-80bc-0a033fb1fdd1 tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "DELETE /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 404 len: 111 microversion: 2.1 time: 0.034457 Nov 16 16:16:47.986713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 134/287] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:16:47 2021] DELETE /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:16:47.994923 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:47.995871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] [instance: 404a11e5-c791-46cd-b455-ef6eca512695] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:48.003758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.004665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.005830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.007270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.025410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] HTTP exception thrown: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. Nov 16 16:16:48.026930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] Returning 404 to user: Instance 404a11e5-c791-46cd-b455-ef6eca512695 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:16:48.028456 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f4893eb4-c411-4b8a-82cc-9cb72b81024c tempest-DeleteServersTestJSON-2089577805 tempest-DeleteServersTestJSON-2089577805-project] 10.222.0.61 "GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695" status: 404 len: 111 microversion: 2.1 time: 0.037392 Nov 16 16:16:48.029182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 154/288] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:47 2021] GET /compute/v2.1/servers/404a11e5-c791-46cd-b455-ef6eca512695 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:16:48.280969 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:48.283371 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:48.296116 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.296854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.297682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.298116 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.323442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:48.324777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:48.341212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.342167 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.343351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.344066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.379857 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:16:48.476382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a6838e83-2663-4674-85af-6d99b185250d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 204 len: 0 microversion: 2.1 time: 0.156241 Nov 16 16:16:48.477342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 155/289] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:16:48 2021] DELETE /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:16:48.484742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c9518bd7-d47e-43e4-a906-3c9ebd6b00e9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:48.487057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c9518bd7-d47e-43e4-a906-3c9ebd6b00e9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:48.493714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9518bd7-d47e-43e4-a906-3c9ebd6b00e9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.494239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9518bd7-d47e-43e4-a906-3c9ebd6b00e9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.495505 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9518bd7-d47e-43e4-a906-3c9ebd6b00e9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.496252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c9518bd7-d47e-43e4-a906-3c9ebd6b00e9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.516102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:48.524785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-61f02f24-1adb-431a-93a4-0ae0c79bfb49 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.252064 Nov 16 16:16:48.529674 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 135/290] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:48 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:48.534622 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-19ec38ac-5249-4d48-be5c-6b23fb3ea0c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:48.534904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c9518bd7-d47e-43e4-a906-3c9ebd6b00e9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055152 Nov 16 16:16:48.535681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-19ec38ac-5249-4d48-be5c-6b23fb3ea0c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:48.536331 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 156/291] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:16:48 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:16:48.543943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19ec38ac-5249-4d48-be5c-6b23fb3ea0c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.544495 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19ec38ac-5249-4d48-be5c-6b23fb3ea0c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.545370 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19ec38ac-5249-4d48-be5c-6b23fb3ea0c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.545758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:48.545935 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19ec38ac-5249-4d48-be5c-6b23fb3ea0c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.548434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:48.559136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.560190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.561781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:48.562801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:48.654067 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-19ec38ac-5249-4d48-be5c-6b23fb3ea0c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.126619 Nov 16 16:16:48.660380 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 136/292] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:48 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:48.748270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:48.755630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1329428063", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "87532d28-954d-488e-beef-2ed2275c6575"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:48.756076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c1e1e669-c8c8-455b-a2e1-75f09bd8a6bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1505 microversion: 2.1 time: 0.218010 Nov 16 16:16:48.756625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 157/293] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:48 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1505 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:48.810516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] validate_networks() for [('87532d28-954d-488e-beef-2ed2275c6575', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:16:49.282020 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:16:49.282693 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:16:49.283152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:16:49.283555 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:16:49.284192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:16:49.295334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.296008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.296964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.297390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.320475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:16:49.325459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for user 99d58fe781aa40b2abf368dcc69b1a53 and project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:16:49.337324 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:16:49.340066 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:16:49.407996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-73e9e490-59b9-4a9a-9bde-0df27e919e64 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656247 Nov 16 16:16:49.414113 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 137/294] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:16:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:16:49.419341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f5962360-41b7-46d8-b884-334276ffcc82 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:49.419929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f5962360-41b7-46d8-b884-334276ffcc82 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:49.517369 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f5962360-41b7-46d8-b884-334276ffcc82 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:49.530899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f5962360-41b7-46d8-b884-334276ffcc82 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1218 microversion: 2.1 time: 0.115301 Nov 16 16:16:49.531486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 158/295] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:49 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:49.546601 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:49.547214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:49.560996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.563342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.564173 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.564665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.667963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cf87111a-e2b4-4b5a-8081-fce7cc174c34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:49.668875 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cf87111a-e2b4-4b5a-8081-fce7cc174c34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:49.680823 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cf87111a-e2b4-4b5a-8081-fce7cc174c34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.681469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cf87111a-e2b4-4b5a-8081-fce7cc174c34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.696952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cf87111a-e2b4-4b5a-8081-fce7cc174c34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.697435 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cf87111a-e2b4-4b5a-8081-fce7cc174c34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.781993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:49.797492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f94fef0c-ecfa-4ef9-8566-5ce1ea3b2b57 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.252898 Nov 16 16:16:49.798647 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 138/296] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:49 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:49.801088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cf87111a-e2b4-4b5a-8081-fce7cc174c34 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.136705 Nov 16 16:16:49.801890 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 159/297] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:49 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:49.803659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:49.804348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:49.815570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.816403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.817325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:49.817948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:49.978503 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:49.986193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fd828581-6528-4bf2-a0d9-c411e28e01c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1505 microversion: 2.1 time: 0.186148 Nov 16 16:16:49.986798 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 139/298] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:49 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:50.549316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:50.550019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:50.557563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:50.558002 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:50.559026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:50.559461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:50.625489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:50.635228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-01dfe7b3-41cc-4ebd-9dbf-4aa56fd7318b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1270 microversion: 2.1 time: 0.090094 Nov 16 16:16:50.636344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 160/299] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:50 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:50.820244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:50.821872 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dc42938e-9dd5-4a9b-afe1-1f9b853c1238 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:50.823857 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:50.829768 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dc42938e-9dd5-4a9b-afe1-1f9b853c1238 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:50.841570 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:50.842510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc42938e-9dd5-4a9b-afe1-1f9b853c1238 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:50.843028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:50.843812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc42938e-9dd5-4a9b-afe1-1f9b853c1238 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:50.844895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:50.846146 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc42938e-9dd5-4a9b-afe1-1f9b853c1238 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:50.846996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:50.847593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc42938e-9dd5-4a9b-afe1-1f9b853c1238 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:50.990364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dc42938e-9dd5-4a9b-afe1-1f9b853c1238 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.180722 Nov 16 16:16:50.991419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 140/300] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:50 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:51.316614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:51.330170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2a0ba9a9-cbf2-41b3-aad7-afe76a7159b2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.518830 Nov 16 16:16:51.339876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 161/301] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:50 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:51.339876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:51.339876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:51.351943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:51.352424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:51.353262 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:51.353693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:51.461111 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:51.474064 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bd42517b-da2a-4dac-abd7-fd216b58b8d7 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Action: 'create', calling method: .version_select at 0x7f3ec8242ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1137492548"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:51.489367 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a6b0ffd6-1cc8-4492-8f58-34a84780c61a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 200 len: 1463 microversion: 2.1 time: 0.156840 Nov 16 16:16:51.490005 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 162/302] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:51 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:51.506403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-58bc514d-f140-4b3b-b785-81a6b2a89a95 req-73d19631-4958-434b-842e-663f57a773c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d694467-d767-4cab-9f05-480b3d073de6", "name": "network-vif-deleted", "tag": "6feab9d3-3675-4ea3-b182-74c25d647b73"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:51.508569 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:51.508569 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:16:51.517108 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-58bc514d-f140-4b3b-b785-81a6b2a89a95 req-73d19631-4958-434b-842e-663f57a773c6 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:51.517826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-58bc514d-f140-4b3b-b785-81a6b2a89a95 req-73d19631-4958-434b-842e-663f57a773c6 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:51.531229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-58bc514d-f140-4b3b-b785-81a6b2a89a95 req-73d19631-4958-434b-842e-663f57a773c6 service nova] Creating event network-vif-deleted:6feab9d3-3675-4ea3-b182-74c25d647b73 for instance 6d694467-d767-4cab-9f05-480b3d073de6 on hv-cinder-78776 Nov 16 16:16:51.536422 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-58bc514d-f140-4b3b-b785-81a6b2a89a95 req-73d19631-4958-434b-842e-663f57a773c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045218 Nov 16 16:16:51.537644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 163/303] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:51.656037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:51.657636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:51.672628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:51.673881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:51.675090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:51.675834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:51.852635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bd42517b-da2a-4dac-abd7-fd216b58b8d7 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.859044 Nov 16 16:16:51.859573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 141/304] 10.222.0.61 () {60 vars in 1154 bytes} [Tue Nov 16 16:16:50 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 861 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 16 16:16:51.864944 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f6fcc1aa-ed21-4e90-afd6-884b63c90435 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80a0ca0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:51.884335 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:51.896210 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7c39cce5-f7f8-42bb-a7ac-a70f16ab3d9f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1276 microversion: 2.1 time: 0.245732 Nov 16 16:16:51.897393 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 164/305] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:51 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:51.929899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f6fcc1aa-ed21-4e90-afd6-884b63c90435 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5" status: 200 len: 345 microversion: 2.1 time: 0.068885 Nov 16 16:16:51.935603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 142/306] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:16:51 2021] GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:52.003261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4f883c65-353e-40c1-9bcc-657dab45ec20 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:52.004176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4f883c65-353e-40c1-9bcc-657dab45ec20 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:52.010847 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f883c65-353e-40c1-9bcc-657dab45ec20 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.011777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f883c65-353e-40c1-9bcc-657dab45ec20 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:52.012628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f883c65-353e-40c1-9bcc-657dab45ec20 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.013284 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f883c65-353e-40c1-9bcc-657dab45ec20 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:52.129616 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4f883c65-353e-40c1-9bcc-657dab45ec20 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.130229 Nov 16 16:16:52.130632 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 165/307] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:51 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:16:52.348335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:52.349542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:52.360573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.361133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:52.363849 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.369403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:52.507299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:52.508016 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 6d694467-d767-4cab-9f05-480b3d073de6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:52.516134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.516807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:52.517750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.518336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:52.537414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] HTTP exception thrown: Instance 6d694467-d767-4cab-9f05-480b3d073de6 could not be found. Nov 16 16:16:52.538514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Returning 404 to user: Instance 6d694467-d767-4cab-9f05-480b3d073de6 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:16:52.540386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a87d1375-28b1-4b1a-aa10-b7d645dac4b6 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6" status: 404 len: 111 microversion: 2.1 time: 0.037300 Nov 16 16:16:52.541501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 166/308] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:52 2021] GET /compute/v2.1/servers/6d694467-d767-4cab-9f05-480b3d073de6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:16:52.663654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-798974070", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "4c7bff69-03f4-470d-bf73-a6b29d12152a"}]}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:52.721411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] validate_networks() for [('4c7bff69-03f4-470d-bf73-a6b29d12152a', None, None, None, None, None)] {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:16:52.736177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:52.747985 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-de8b7fa7-90c7-4196-856d-8ee4498eca3c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.403772 Nov 16 16:16:52.748928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 143/309] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:52 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:52.914589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:52.916054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:52.926470 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.926935 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:52.927721 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:52.928147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:53.299640 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:53.310249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-edc601fa-1838-462b-834c-27ee12570c65 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.399508 Nov 16 16:16:53.315228 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 144/310] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:52 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:53.319859 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-48bad961-ebba-4722-abb2-f0b2a8b0e88e tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec81b5790>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:53.369356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-48bad961-ebba-4722-abb2-f0b2a8b0e88e tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5" status: 200 len: 346 microversion: 2.1 time: 0.052852 Nov 16 16:16:53.370001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 145/311] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:16:53 2021] GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5 => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:53.376500 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-15daff9f-42ad-4ba2-b05b-256acd13eba4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:53.377669 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-15daff9f-42ad-4ba2-b05b-256acd13eba4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:53.384724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15daff9f-42ad-4ba2-b05b-256acd13eba4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:53.385096 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15daff9f-42ad-4ba2-b05b-256acd13eba4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:53.385882 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15daff9f-42ad-4ba2-b05b-256acd13eba4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:53.386309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15daff9f-42ad-4ba2-b05b-256acd13eba4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:53.402551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:16:53.402964 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:16:53.403420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:16:53.403815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:16:53.404216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:16:53.413597 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:53.414306 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:53.415484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:53.416091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:53.436305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Getting quotas for project ba4d0c4ca68d4ce0bb5542957d6c2874. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:16:53.441186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Getting quotas for user eea5bfe0bcfa4568986c6362ecfbe19d and project ba4d0c4ca68d4ce0bb5542957d6c2874. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:16:53.458546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:16:53.463580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:16:53.538998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-75844001-d2fb-49cc-a2ac-63658f1a2882 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878068 Nov 16 16:16:53.539921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 167/312] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:16:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:16:53.552136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d344142a-0f05-43b6-9082-4794c7166aa8 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Action: 'create', calling method: .version_select at 0x7f3ec812d9d0>, body: {"snapshot": {"volume_id": "2abf6534-251c-47a9-b37f-225f800771c5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-560421690"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:53.855427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d344142a-0f05-43b6-9082-4794c7166aa8 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.310146 Nov 16 16:16:53.865249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 168/313] 10.222.0.61 () {60 vars in 1161 bytes} [Tue Nov 16 16:16:53 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:53.870235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d9dfb124-954a-4cfc-b1f9-f74ac6a2f815 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:53.877862 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d9dfb124-954a-4cfc-b1f9-f74ac6a2f815 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:53.936237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d9dfb124-954a-4cfc-b1f9-f74ac6a2f815 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:53.943600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d9dfb124-954a-4cfc-b1f9-f74ac6a2f815 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1213 microversion: 2.1 time: 0.076990 Nov 16 16:16:53.945317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 169/314] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:53 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:53.960795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-3a99d0ad-df04-435d-b3db-0d268a7664f9 req-9b864822-8946-4f20-8ee5-ee088c669563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45fbcda0-44c4-45be-9b1f-96d4eceda3d8", "tag": "abdeea90-028a-4b7a-9617-51b8c519f3d5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:16:53.962697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:16:53.962697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:16:53.970420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-3a99d0ad-df04-435d-b3db-0d268a7664f9 req-9b864822-8946-4f20-8ee5-ee088c669563 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:53.970957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-3a99d0ad-df04-435d-b3db-0d268a7664f9 req-9b864822-8946-4f20-8ee5-ee088c669563 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:53.982887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-3a99d0ad-df04-435d-b3db-0d268a7664f9 req-9b864822-8946-4f20-8ee5-ee088c669563 service nova] Creating event network-changed:abdeea90-028a-4b7a-9617-51b8c519f3d5 for instance 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 on hv-cinder-78776 Nov 16 16:16:53.988049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-3a99d0ad-df04-435d-b3db-0d268a7664f9 req-9b864822-8946-4f20-8ee5-ee088c669563 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040982 Nov 16 16:16:53.989051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 170/315] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:53.995563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:53.996425 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:54.003280 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:54.003953 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:54.005056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:54.005412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:54.146127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:54.154111 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f6c00d0e-9714-4af8-b01d-3a43d537b449 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.163706 Nov 16 16:16:54.154806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 171/316] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:53 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:54.159132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7c62b7f2-a04b-4874-b240-8b25ecc029e4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec8025f70>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:54.189365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7c62b7f2-a04b-4874-b240-8b25ecc029e4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.033454 Nov 16 16:16:54.189930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 172/317] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:16:54 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:54.199707 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3b2f3a7c-a776-4547-a7ac-71ef31cb5a35 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec8207dc0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:54.229043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3b2f3a7c-a776-4547-a7ac-71ef31cb5a35 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.032950 Nov 16 16:16:54.229620 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 173/318] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Nov 16 16:16:54 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:54.239252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-69bd19c5-228e-4ba3-b8f5-ae34c60335c7 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec805b790>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:54.268709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-69bd19c5-228e-4ba3-b8f5-ae34c60335c7 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.032915 Nov 16 16:16:54.269343 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 174/319] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:16:54 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:16:54.332878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:54.333471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:54.340284 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:54.340730 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:54.341504 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:54.341937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:54.476508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:54.484694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a1bb0f13-8cd2-44d3-b99c-d6bf0d333fbd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.156393 Nov 16 16:16:54.485267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 175/320] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:54 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:54.962722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:54.963408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:54.969878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:54.970330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:54.971159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:54.971592 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:55.033188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:55.041091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fe68e884-3e80-4e2a-8f9d-3982a2bf1af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1217 microversion: 2.1 time: 0.082407 Nov 16 16:16:55.041657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 176/321] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:54 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:55.174137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:55.174137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:55.178669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:55.179109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:55.180042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:55.180575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:55.313216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:55.320778 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-add219a8-2a6d-4c91-8993-017eec59628d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.152941 Nov 16 16:16:55.321541 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 177/322] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:55 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:55.326003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8e2b7cd8-0f99-408b-8536-c4005f04fb1a tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec8025ee0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:55.355503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8e2b7cd8-0f99-408b-8536-c4005f04fb1a tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.032926 Nov 16 16:16:55.356061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 178/323] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:16:55 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:55.504872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:55.505483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:55.512061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:55.512539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:55.513283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:55.513728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:55.652950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:55.660376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c180fa14-6fbb-4f84-8d5c-849703c0c399 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.159169 Nov 16 16:16:55.661152 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 179/324] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:55 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:56.058407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:56.059120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:56.065657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:56.066105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:56.067031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:56.067548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:56.134720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:56.144598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6a8a563a-d931-4ffd-b978-02a79c96e62c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1217 microversion: 2.1 time: 0.089984 Nov 16 16:16:56.145097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 180/325] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:56 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:56.340945 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:56.341569 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:56.347577 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:56.348014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:56.348772 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:56.349192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:56.488371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:56.496147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e7cd0a74-6f3f-4a3f-be61-27739cc2d5be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.158887 Nov 16 16:16:56.496719 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 181/326] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:56 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:56.501160 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bb1936c3-55da-453a-8b06-d73faafc2a05 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80e7e50>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:56.535307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bb1936c3-55da-453a-8b06-d73faafc2a05 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.037529 Nov 16 16:16:56.535854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 182/327] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:16:56 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:56.676785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:56.677476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:56.683579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:56.684024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:56.684834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:56.685290 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:56.863737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:56.871916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d0eb78bf-246a-433f-9715-f9ef554fe9c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.198778 Nov 16 16:16:56.872573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 183/328] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:56 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:57.162563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:57.163243 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:57.170181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:57.170588 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:57.171378 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:57.171814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:57.242849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:57.250279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fc9840e7-1e90-4bd1-a561-e8eb95b0fe4c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1217 microversion: 2.1 time: 0.091511 Nov 16 16:16:57.250878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 184/329] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:57 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:57.513581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:57.514560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:57.527020 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:57.527461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:57.528237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:57.528689 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:57.663163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:57.676400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-14f33c68-1cbf-41f0-8e9b-1c55a3d23445 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.166872 Nov 16 16:16:57.677099 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 185/330] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:57 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:16:57.682457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0f474638-acbf-4080-8fde-d42f3b834d3b tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80e7280>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:57.715418 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0f474638-acbf-4080-8fde-d42f3b834d3b tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.037073 Nov 16 16:16:57.716071 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 186/331] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:16:57 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:57.889650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:57.890287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:57.896953 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:57.897401 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:57.898553 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:57.899257 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:58.033897 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:58.041353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7344adbf-854c-4bc5-89a4-12313321a723 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.155480 Nov 16 16:16:58.041916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 187/332] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:57 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:58.267187 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:58.267921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:58.275385 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:58.275834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:58.276603 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:58.277030 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:58.353554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:58.361439 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-867f364e-c270-4268-82cd-8a4565238e64 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1217 microversion: 2.1 time: 0.098071 Nov 16 16:16:58.362088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 188/333] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:58 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:58.700742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:58.701332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:58.708621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:58.709086 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:58.710026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:58.710536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:58.888360 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:58.895691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b33be20c-2954-4edf-8829-0540712c1fa8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.199641 Nov 16 16:16:58.896245 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 189/334] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:58 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:58.900914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1da52529-e4a2-4bfe-b964-aa27d21a5023 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec81dd700>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:58.930963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1da52529-e4a2-4bfe-b964-aa27d21a5023 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.033496 Nov 16 16:16:58.931519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 190/335] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:16:58 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:16:59.062139 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:59.063166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:59.072555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:59.073007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:59.073771 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:59.074199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:59.213879 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:59.221318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d30e7551-d847-401f-9cb4-2e1c79408f07 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.165584 Nov 16 16:16:59.221886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 191/336] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:59 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:59.380339 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:59.380963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:59.390139 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:59.390895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:59.392220 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:59.392907 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:59.457180 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:16:59.466425 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-41935921-8c38-475c-a3c1-8d6835ab3055 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1217 microversion: 2.1 time: 0.090722 Nov 16 16:16:59.467255 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 192/337] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:59 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:16:59.912892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:16:59.913500 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:16:59.919638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:59.920078 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:16:59.920849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:16:59.921274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:00.064238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:00.072599 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e4688075-dff0-4ab4-91e7-536178e89114 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.163395 Nov 16 16:17:00.073169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 193/338] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:16:59 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:00.077485 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d0ee3b23-44a3-4550-8912-d33b7bc7c668 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80b2dc0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:00.107475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d0ee3b23-44a3-4550-8912-d33b7bc7c668 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.033261 Nov 16 16:17:00.108036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 194/339] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:00 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:00.225401 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-15daff9f-42ad-4ba2-b05b-256acd13eba4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 6.853711 Nov 16 16:17:00.226776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 146/340] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:16:53 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 6856 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:00.238112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:00.238758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:00.245686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:00.246197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:00.247927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:00.247927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:00.484150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:00.484921 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:00.486643 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:00.494915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:00.495199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-99fbabcb-af48-4e78-8f1e-54d52cfbf55e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.260728 Nov 16 16:17:00.495692 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:00.495815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 195/341] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:00 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:00.500515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:00.501052 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:00.567159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:00.575151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4fe7ca07-71b5-4a6c-b5b3-5ac34bb8cd00 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1265 microversion: 2.1 time: 0.095520 Nov 16 16:17:00.575748 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 147/342] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:00 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:01.090661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:01.091169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:01.097341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.097975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.098838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.099274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.121463 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-63bc190c-096b-40b1-b6b4-99f428f1cabd tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec37cdf70>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:01.159737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-63bc190c-096b-40b1-b6b4-99f428f1cabd tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.043773 Nov 16 16:17:01.160496 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 148/343] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:01 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:01.238358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-78877536-471d-4faa-b88f-e991b8d2383d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:01.239346 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-78877536-471d-4faa-b88f-e991b8d2383d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:01.246813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-78877536-471d-4faa-b88f-e991b8d2383d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.247242 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-78877536-471d-4faa-b88f-e991b8d2383d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.248020 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-78877536-471d-4faa-b88f-e991b8d2383d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.248446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-78877536-471d-4faa-b88f-e991b8d2383d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.252585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:01.260516 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-94e9e56c-d2c4-4772-af15-e706d641b34b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.173953 Nov 16 16:17:01.261059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 196/344] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:01 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:01.517152 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:01.518317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:01.526657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.527103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.527904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.528386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.667772 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:01.675484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-09e99e4a-4d91-4f8e-a4fe-e84cef7683cb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.165014 Nov 16 16:17:01.676059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 197/345] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:01 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:01.680224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:01.680816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:01.687246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.687684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.688460 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:01.688891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:01.755043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:01.762697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-298f7aab-4222-47fc-887a-83782c8d3f7e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1271 microversion: 2.1 time: 0.085660 Nov 16 16:17:01.763249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 198/346] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:01 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:02.173672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2668f626-d47f-468d-aca5-69ada1a713ae tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec812d0d0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:02.204366 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2668f626-d47f-468d-aca5-69ada1a713ae tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.035399 Nov 16 16:17:02.204919 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 199/347] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:02 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:02.280653 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:02.281279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:02.288226 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:02.288680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:02.289454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:02.289925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:02.601748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:02.609797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8c81b6e6-078c-4676-9453-a1118ddc50a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.334949 Nov 16 16:17:02.610358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 200/348] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:02 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:02.692875 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:02.693483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:02.700802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:02.701380 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:02.702460 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:02.702955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:02.859758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:02.873831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9f2247f8-bfa1-493a-9755-068592745aa6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.184221 Nov 16 16:17:02.874916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 201/349] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:02 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:02.883007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:02.884177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:02.895776 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:02.896601 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:02.897480 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:02.898304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:02.985646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:02.997048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6b65158a-5a4f-4293-9964-ff5b19d48af0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1271 microversion: 2.1 time: 0.120336 Nov 16 16:17:02.998763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 202/350] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:02 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:03.216882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0a8f2180-b4cd-46de-8bc4-e9bd33f800df tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec3f9faf0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:03.249601 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0a8f2180-b4cd-46de-8bc4-e9bd33f800df tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.036446 Nov 16 16:17:03.250408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 203/351] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:03 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:03.629731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:03.630436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:03.637494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:03.637871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:03.638680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:03.639111 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:03.781207 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:03.791844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-060ca4bc-45b3-48b8-805a-a788ddec2532 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.166228 Nov 16 16:17:03.792577 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 204/352] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:03 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:03.906133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:03.906852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:03.915462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:03.916050 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:03.917362 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:03.917956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:04.055123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:04.063340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c4f74a08-1b1a-4d05-ae72-86b9b0c76120 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.162697 Nov 16 16:17:04.064082 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 205/353] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:03 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:04.078241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:04.078873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:04.084807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:04.085254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:04.086029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:04.086498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:04.148659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:04.156114 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a5ce9f3a-3843-46a2-8027-69455123c8de tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1271 microversion: 2.1 time: 0.081558 Nov 16 16:17:04.156744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 206/354] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:04 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:04.262003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-596c26a5-1f52-4f64-94f3-ebef0bd62d80 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec812d3a0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:04.291661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-596c26a5-1f52-4f64-94f3-ebef0bd62d80 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.033445 Nov 16 16:17:04.292296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 207/355] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:04 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:04.810780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:04.811431 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:04.817813 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:04.818263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:04.819070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:04.819489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:04.959805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:04.970034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1cd6ec17-9a69-4c81-acb3-42ae08cd68fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.163413 Nov 16 16:17:04.970871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 208/356] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:04 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:05.084386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:05.084965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:05.091986 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:05.092441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:05.093406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:05.093894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:05.235821 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:05.247403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f1eaeea5-2c67-44eb-a93a-567abc5b8d8c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.169397 Nov 16 16:17:05.247973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 209/357] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:05 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:05.252294 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:05.252876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:05.258731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:05.259165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:05.259922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:05.260341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:05.328941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:05.337543 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e6047a0a-30c2-4791-809a-20b1ece1e574 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1271 microversion: 2.1 time: 0.088501 Nov 16 16:17:05.338033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 210/358] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:05 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:05.342889 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4c1279c6-4d75-486e-81c4-5199bd76cb1a tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec3f9fb80>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:05.376027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4c1279c6-4d75-486e-81c4-5199bd76cb1a tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.036904 Nov 16 16:17:05.376590 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 211/359] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:05 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:05.995975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:05.996645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:06.002992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:06.003432 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:06.004291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:06.004720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:06.156158 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:06.163809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bbcd4fcc-ed75-4d73-a1bd-3a60291f2bbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.174705 Nov 16 16:17:06.164168 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 212/360] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:05 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:06.264084 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:06.264698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:06.270998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:06.271445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:06.272237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:06.272985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:06.682585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:06.689720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-de4a46fa-af68-46b2-90af-732b74108316 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.429411 Nov 16 16:17:06.690276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 213/361] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:06 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:06.697786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:06.697786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:06.701702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:06.702169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:06.703157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:06.703621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:06.766525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:06.774503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-56824590-c008-4897-be26-6980dd17c8d0 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1271 microversion: 2.1 time: 0.083198 Nov 16 16:17:06.775036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 214/362] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:06 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:06.779481 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5f750e0c-77bd-48dd-8c29-5e55d971cfc3 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec82e4dc0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:06.808926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5f750e0c-77bd-48dd-8c29-5e55d971cfc3 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.032838 Nov 16 16:17:06.809623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 215/363] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:06 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:07.181170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:07.181806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:07.188374 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:07.188815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:07.189578 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:07.190000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:07.339691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:07.347793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-072eb54e-0d6f-4a65-b35f-8c8521614cf1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.170857 Nov 16 16:17:07.348380 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 216/364] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:07 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:07.710902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:07.711887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:07.722696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:07.723453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:07.724725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:07.725483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:07.865283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:07.874029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3db3b62b-a846-4586-86d7-55039939ba78 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.169510 Nov 16 16:17:07.874636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 217/365] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:07 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:07.878982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:07.879578 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:07.887465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:07.887927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:07.888716 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:07.889166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:07.914557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-78877536-471d-4faa-b88f-e991b8d2383d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 6.679551 Nov 16 16:17:07.922434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 149/366] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:01 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 6682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:17:07.922434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f9d5afab-759f-4cc1-980e-56273e9f30d8 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec37cdd30>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:07.965223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f9d5afab-759f-4cc1-980e-56273e9f30d8 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.048002 Nov 16 16:17:07.966089 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 150/367] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:07 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:08.038161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:08.045723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-192c5309-3b12-4a6c-aff4-b6034461f361 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.170174 Nov 16 16:17:08.046302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 218/368] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:07 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:08.367404 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:08.368668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:08.375235 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:08.375689 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:08.376733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:08.377329 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:08.514160 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:08.521652 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6337245f-046f-40fc-ba41-2ce9d52921a1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.159064 Nov 16 16:17:08.522210 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 151/369] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:08 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:08.583304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-d06cf9df-f2b1-473a-ab9a-c9db4e09fbc2 req-922ffe02-b30b-4e72-9b7c-fedbb9e8e10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a69b9f-26ec-45c2-bdd8-8e38efeb110f", "tag": "edf6e728-1de4-4548-a79d-1bb26d3dd900"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:08.585004 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:17:08.585004 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:17:08.592859 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-d06cf9df-f2b1-473a-ab9a-c9db4e09fbc2 req-922ffe02-b30b-4e72-9b7c-fedbb9e8e10b service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:08.593305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-d06cf9df-f2b1-473a-ab9a-c9db4e09fbc2 req-922ffe02-b30b-4e72-9b7c-fedbb9e8e10b service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:08.605142 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-d06cf9df-f2b1-473a-ab9a-c9db4e09fbc2 req-922ffe02-b30b-4e72-9b7c-fedbb9e8e10b service nova] Creating event network-changed:edf6e728-1de4-4548-a79d-1bb26d3dd900 for instance 28a69b9f-26ec-45c2-bdd8-8e38efeb110f on hv-cinder-78776 Nov 16 16:17:08.610105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-d06cf9df-f2b1-473a-ab9a-c9db4e09fbc2 req-922ffe02-b30b-4e72-9b7c-fedbb9e8e10b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030478 Nov 16 16:17:08.610725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 219/370] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:17:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:08.892068 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:08.892828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:08.899884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:08.900269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:08.901119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:08.901635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:08.970546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-808ec9ac-7d46-41e5-b69c-d9ebfd094897 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:08.971227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-808ec9ac-7d46-41e5-b69c-d9ebfd094897 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:08.978403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-808ec9ac-7d46-41e5-b69c-d9ebfd094897 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:08.979215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-808ec9ac-7d46-41e5-b69c-d9ebfd094897 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:08.980866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-808ec9ac-7d46-41e5-b69c-d9ebfd094897 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:08.981651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-808ec9ac-7d46-41e5-b69c-d9ebfd094897 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:09.044407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:09.051971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fb9dffec-8833-4771-9a89-01b6cb9423e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.163650 Nov 16 16:17:09.052580 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 152/371] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:08 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:09.057249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c4b41037-4bee-4aa7-bf89-907db8311aad tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80e78b0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:09.089379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c4b41037-4bee-4aa7-bf89-907db8311aad tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 287 microversion: 2.1 time: 0.035593 Nov 16 16:17:09.089927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 153/372] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:09 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:09.094584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:09.095172 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:09.101820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:09.102268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:09.103088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:09.103520 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:09.246122 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:09.254345 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-89ff1f03-08fa-4ff8-80eb-9df10a5c5dca tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.163293 Nov 16 16:17:09.255013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 154/373] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:09 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:09.259467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fab22f43-6ea0-4676-ac2c-1438db4cb5c4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec3784940>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:09.319997 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fab22f43-6ea0-4676-ac2c-1438db4cb5c4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 202 len: 0 microversion: 2.1 time: 0.063956 Nov 16 16:17:09.320755 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 155/374] 10.222.0.61 () {58 vars in 1253 bytes} [Tue Nov 16 16:17:09 2021] DELETE /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:17:09.329353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7cbc4bc4-fb02-42a3-b022-60c739aca537 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec37eee50>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:09.359306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7cbc4bc4-fb02-42a3-b022-60c739aca537 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.033769 Nov 16 16:17:09.359878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 156/375] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:09 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:09.542666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:09.543300 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:09.550671 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:09.551054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:09.551831 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:09.552250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:09.692970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:09.700856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b07cb3b4-d4dd-4476-9e24-f80849d0c539 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.163974 Nov 16 16:17:09.701428 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 157/376] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:09 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:10.069116 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:10.069793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:10.076584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:10.077004 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:10.077789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:10.078214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:10.212856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:10.220415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ca78b7af-b80d-48ea-98d5-46df60a37db2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.155061 Nov 16 16:17:10.220982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 158/377] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:10 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:10.272268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:10.273196 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:10.280965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:10.281395 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:10.282193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:10.282666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:10.425460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:10.433365 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a8416eaf-1360-4043-ae91-0fbcd7444ffa tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.164710 Nov 16 16:17:10.433927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 159/378] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:10 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:10.438142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3e94a2b2-4bdb-4b0a-be0c-ef28b0c84d42 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec37a5d30>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:10.474958 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3e94a2b2-4bdb-4b0a-be0c-ef28b0c84d42 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.039915 Nov 16 16:17:10.475504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 160/379] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:10 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:10.723654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:10.724552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:10.733544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:10.734011 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:10.734815 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:10.735273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:10.874730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:10.882356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-117a42e0-2913-4019-80c1-d4a60b24b1f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.165982 Nov 16 16:17:10.882927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 161/380] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:10 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:11.241507 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:11.242597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:11.250848 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:11.251287 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:11.252061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:11.252491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:11.394445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:11.402581 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9a1a4f57-8805-424e-9b2f-a9d744deb639 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.166988 Nov 16 16:17:11.403129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 162/381] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:11 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:11.450751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:11.451361 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:11.457383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:11.457828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:11.458636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:11.459065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:11.497445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-808ec9ac-7d46-41e5-b69c-d9ebfd094897 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 2.531269 Nov 16 16:17:11.498661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 220/382] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:08 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:11.503914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-aa9b7099-809f-4210-acfc-c26c43387866 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec8080700>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:11.538825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-aa9b7099-809f-4210-acfc-c26c43387866 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.038833 Nov 16 16:17:11.540133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 221/383] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:11 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:11.607703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:11.615471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b59adb2b-01e4-4a20-abe2-465cd44965b1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.168529 Nov 16 16:17:11.616003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 163/384] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:11 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:11.905561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:11.907169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:11.914128 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:11.914621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:11.915408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:11.916097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:12.058307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:12.066356 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3be0faaf-cff6-4d60-9d7f-1a6b1f167ff4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.166904 Nov 16 16:17:12.066946 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 222/385] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:11 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:12.421224 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:12.421866 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:12.428845 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:12.429345 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:12.430103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:12.430511 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:12.508940 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f880c9d0-9cae-4803-8e22-4e45d12f48c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:12.510050 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f880c9d0-9cae-4803-8e22-4e45d12f48c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:12.517013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f880c9d0-9cae-4803-8e22-4e45d12f48c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:12.517442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f880c9d0-9cae-4803-8e22-4e45d12f48c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:12.518239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f880c9d0-9cae-4803-8e22-4e45d12f48c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:12.518709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f880c9d0-9cae-4803-8e22-4e45d12f48c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:12.575439 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:12.582977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d5b290b2-5946-46aa-a47d-9f10fd3429ff tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.166250 Nov 16 16:17:12.583552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 164/386] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:12 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:12.587980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ec1c368c-70f4-4e59-9979-72de60f95cae tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80ffdc0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:12.618440 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ec1c368c-70f4-4e59-9979-72de60f95cae tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.033781 Nov 16 16:17:12.618988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 165/387] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:12 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:12.632024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:12.632626 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:12.638656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:12.639103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:12.639869 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:12.640300 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:12.781737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:12.792870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f63ecc34-56a9-4846-adc5-cc37c0a3e35d tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.163913 Nov 16 16:17:12.793616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 166/388] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:12 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:13.087314 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:13.088000 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:13.097250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:13.097980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:13.099277 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:13.099947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:13.251165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:13.259504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0e429893-1882-46a9-ba12-9193456effca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.178347 Nov 16 16:17:13.260077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 167/389] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:13 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:13.601637 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:13.602313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:13.609419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:13.609862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:13.610675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:13.611143 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:13.751385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:13.759355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7ca4a2d7-d670-4d6b-ba5d-c6b2b847a79f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.161791 Nov 16 16:17:13.759919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 168/390] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:13 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:13.764248 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-962db9d3-21ec-4f80-8d7a-fb03620b788c tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec8242c10>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:13.793838 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-962db9d3-21ec-4f80-8d7a-fb03620b788c tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.032883 Nov 16 16:17:13.794523 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 169/391] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:13 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:13.813650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:13.814248 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:13.820724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:13.821153 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:13.822100 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:13.822358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:13.969310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:13.977293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a42af476-4751-4a97-b10a-e7fadd2e0c75 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.167165 Nov 16 16:17:13.977854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 170/392] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:13 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:14.277440 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:14.278059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:14.284681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:14.285129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:14.286135 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:14.286604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:14.425192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:14.436717 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-67676611-2dc1-4d8d-9fc2-0af7a4780613 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.162997 Nov 16 16:17:14.437636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 171/393] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:14 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:14.777255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:14.777970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:14.784948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:14.785394 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:14.786205 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:14.786673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:14.928505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:14.936046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d8aa9607-dd9e-467b-9fb5-cd602cc4af80 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.162581 Nov 16 16:17:14.936664 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 172/394] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:14 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:14.940834 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4931705d-2a21-47da-b471-64f99832aec4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec3784d30>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:14.970547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4931705d-2a21-47da-b471-64f99832aec4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.032837 Nov 16 16:17:14.971097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 173/395] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:14 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:14.993721 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:14.994320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:15.000527 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:15.000976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:15.001746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:15.002176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:15.161584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:15.169305 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-38172e6a-0288-4b24-bea0-de52ee2c059b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.179005 Nov 16 16:17:15.169863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 174/396] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:14 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:15.463674 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:15.464570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:15.474932 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:15.475691 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:15.476970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:15.477695 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:15.632116 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:15.639829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d9fd32e5-c1b6-4756-8c8d-91a11f0238a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.182296 Nov 16 16:17:15.640514 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 175/397] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:15 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:15.953813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:15.954574 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:15.961856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:15.962601 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:15.963856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:15.964758 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:16.106110 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:16.114600 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-550a7cea-04fa-4090-ab17-935a9588dd40 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.164887 Nov 16 16:17:16.115375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 176/398] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:15 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:16.119506 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-94e1b613-5a20-4fd1-85af-dbba4e5cb249 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec8242280>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:16.149717 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f880c9d0-9cae-4803-8e22-4e45d12f48c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 3.644404 Nov 16 16:17:16.150472 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 223/399] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:12 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 3646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:16.150825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-94e1b613-5a20-4fd1-85af-dbba4e5cb249 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 200 len: 286 microversion: 2.1 time: 0.034569 Nov 16 16:17:16.153930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 177/400] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:16 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:16.186369 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:16.187530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:16.195073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:16.195596 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:16.196541 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:16.196980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:16.347723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:16.355041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b176b16f-bd31-4722-9737-2782e76e61fd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.173167 Nov 16 16:17:16.355630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 224/401] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:16 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:16.657846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:16.658504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:16.665048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:16.665496 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:16.666283 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:16.666747 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:16.813571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:16.821903 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-92e42318-87ea-4b62-aa36-88d969070689 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.168270 Nov 16 16:17:16.822481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 178/402] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:16 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:17.132245 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:17.132705 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:17.139331 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.139791 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:17.140560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.140982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:17.161182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1e4e2563-a8d2-4e6d-a110-4f78fb6e379f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:17.162354 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1e4e2563-a8d2-4e6d-a110-4f78fb6e379f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:17.169553 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e4e2563-a8d2-4e6d-a110-4f78fb6e379f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.169997 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e4e2563-a8d2-4e6d-a110-4f78fb6e379f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:17.170813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e4e2563-a8d2-4e6d-a110-4f78fb6e379f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.171254 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e4e2563-a8d2-4e6d-a110-4f78fb6e379f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:17.279968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:17.288155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-129b0b8e-7ba0-4e65-aa3e-689612f19571 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.159634 Nov 16 16:17:17.288732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 225/403] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:17 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:17.293049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-215b49d9-6c14-4afe-a3c0-23e2c13d810c tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec812d1f0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:17.317340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-215b49d9-6c14-4afe-a3c0-23e2c13d810c tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] HTTP exception thrown: Snapshot c9868181-f126-4d8d-9072-1897c0a3fe57 could not be found. Nov 16 16:17:17.317917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-215b49d9-6c14-4afe-a3c0-23e2c13d810c tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Returning 404 to user: Snapshot c9868181-f126-4d8d-9072-1897c0a3fe57 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:17:17.318753 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-215b49d9-6c14-4afe-a3c0-23e2c13d810c tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57" status: 404 len: 111 microversion: 2.1 time: 0.029019 Nov 16 16:17:17.319267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 226/404] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:17:17 2021] GET /compute/v2.1/os-snapshots/c9868181-f126-4d8d-9072-1897c0a3fe57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:17:17.330644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2fb7deca-76dc-4ec3-b88f-61f913d0e7f4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec3f9f040>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:17.399235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2fb7deca-76dc-4ec3-b88f-61f913d0e7f4 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5" status: 202 len: 0 microversion: 2.1 time: 0.074712 Nov 16 16:17:17.399812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 227/405] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Nov 16 16:17:17 2021] DELETE /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:17:17.405253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:17.405882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:17.412324 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.412757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:17.413528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.413988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:17.436577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1e4e2563-a8d2-4e6d-a110-4f78fb6e379f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.279077 Nov 16 16:17:17.441668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 179/406] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:17 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:17:17.446402 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0fbce57e-b886-4230-82cf-c4fcb999bda5 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec3784f70>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:17.500134 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0fbce57e-b886-4230-82cf-c4fcb999bda5 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5" status: 200 len: 345 microversion: 2.1 time: 0.060775 Nov 16 16:17:17.501132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 180/407] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:17:17 2021] GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:17.576024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:17.583650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-87bc3895-12b5-4f89-a106-0dcb03d9bca2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.182746 Nov 16 16:17:17.584219 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 228/408] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:17 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:17.840112 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:17.840845 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:17.847542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.848001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:17.848776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:17.849212 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:18.004336 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:18.012294 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e25e496a-dec3-469c-9b42-4b69b5173109 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.176538 Nov 16 16:17:18.012886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 181/409] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:17 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:18.308021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:18.308651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:18.318043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:18.318542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:18.319746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:18.320435 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:18.448757 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7b30a041-7c49-44f9-8375-b93cd154aa69 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:18.449666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7b30a041-7c49-44f9-8375-b93cd154aa69 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:18.456456 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b30a041-7c49-44f9-8375-b93cd154aa69 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:18.456980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b30a041-7c49-44f9-8375-b93cd154aa69 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:18.458267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b30a041-7c49-44f9-8375-b93cd154aa69 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:18.458731 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b30a041-7c49-44f9-8375-b93cd154aa69 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:18.468344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:18.476596 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-715e5d19-49c7-4115-a661-a62329fe09cd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.174666 Nov 16 16:17:18.477308 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 229/410] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:18 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:18.513759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-60cf3b71-f649-4b6f-8be9-85b79ffa8312 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec81dd5e0>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:18.545520 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-60cf3b71-f649-4b6f-8be9-85b79ffa8312 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] HTTP exception thrown: Volume 2abf6534-251c-47a9-b37f-225f800771c5 could not be found. Nov 16 16:17:18.546108 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-60cf3b71-f649-4b6f-8be9-85b79ffa8312 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Returning 404 to user: Volume 2abf6534-251c-47a9-b37f-225f800771c5 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:17:18.546955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-60cf3b71-f649-4b6f-8be9-85b79ffa8312 tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5" status: 404 len: 109 microversion: 2.1 time: 0.036922 Nov 16 16:17:18.547478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 230/411] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:17:18 2021] GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:17:18.561482 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-684d17de-01b9-4d32-b0aa-dfcecc37022d tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80d7b80>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:18.590187 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-684d17de-01b9-4d32-b0aa-dfcecc37022d tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] HTTP exception thrown: Volume 2abf6534-251c-47a9-b37f-225f800771c5 could not be found. Nov 16 16:17:18.591115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-684d17de-01b9-4d32-b0aa-dfcecc37022d tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Returning 404 to user: Volume 2abf6534-251c-47a9-b37f-225f800771c5 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:17:18.592314 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-684d17de-01b9-4d32-b0aa-dfcecc37022d tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5" status: 404 len: 109 microversion: 2.1 time: 0.034346 Nov 16 16:17:18.593039 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 231/412] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Nov 16 16:17:18 2021] DELETE /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:17:18.601062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0f459c13-32ee-41dd-9740-ffa696f8f4da tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Calling method '.version_select at 0x7f3ec80d7f70>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:18.617659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7b30a041-7c49-44f9-8375-b93cd154aa69 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.172449 Nov 16 16:17:18.618413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 182/413] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:18 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:17:18.624176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:18.625047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:18.632307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-0f459c13-32ee-41dd-9740-ffa696f8f4da tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] HTTP exception thrown: Volume 2abf6534-251c-47a9-b37f-225f800771c5 could not be found. Nov 16 16:17:18.633194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0f459c13-32ee-41dd-9740-ffa696f8f4da tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] Returning 404 to user: Volume 2abf6534-251c-47a9-b37f-225f800771c5 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:17:18.633290 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:18.633609 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:18.634216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0f459c13-32ee-41dd-9740-ffa696f8f4da tempest-VolumesSnapshotsTestJSON-1722995175 tempest-VolumesSnapshotsTestJSON-1722995175-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5" status: 404 len: 109 microversion: 2.1 time: 0.036573 Nov 16 16:17:18.634772 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 232/414] 10.222.0.61 () {58 vars in 1244 bytes} [Tue Nov 16 16:17:18 2021] GET /compute/v2.1/os-volumes/2abf6534-251c-47a9-b37f-225f800771c5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:17:18.642623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:18.643121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:18.780879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:18.788294 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4b6bcb6f-a551-438e-b137-e1a35797c754 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.168632 Nov 16 16:17:18.788851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 183/415] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:18 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:19.030790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:19.031741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:19.043264 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.043731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.044556 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.044952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.193789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:19.202048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d815ec7b-d534-4d59-b33c-339cb6bdd7f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.175624 Nov 16 16:17:19.202643 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 233/416] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:19 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:19.493217 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:19.494488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:19.501532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.501983 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.502943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.503381 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.631064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-38cc54f3-d4d8-48cb-aa88-ce89d3316639 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:19.631996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-38cc54f3-d4d8-48cb-aa88-ce89d3316639 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:19.639268 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38cc54f3-d4d8-48cb-aa88-ce89d3316639 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.640109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38cc54f3-d4d8-48cb-aa88-ce89d3316639 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.641526 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38cc54f3-d4d8-48cb-aa88-ce89d3316639 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.642292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38cc54f3-d4d8-48cb-aa88-ce89d3316639 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.660102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:19.667965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-90d7e998-b6a9-42fe-9e2a-4f8f38a10d2d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.178390 Nov 16 16:17:19.668776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 184/417] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:19 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:19.742319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-38cc54f3-d4d8-48cb-aa88-ce89d3316639 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.115127 Nov 16 16:17:19.743612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 234/418] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:19 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:19.811111 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:19.812176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:19.821222 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.822221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.823037 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:19.823537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:19.995085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:20.002292 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bc978d1c-1400-4122-8cc6-778b6cda25bc tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.200801 Nov 16 16:17:20.014991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 185/419] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:19 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:20.219887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:20.221913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:20.227840 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:20.228307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:20.229060 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:20.229516 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:20.384913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:20.395409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1d03249d-0fa5-47c0-96e2-eeaed162fa0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.179742 Nov 16 16:17:20.395989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 235/420] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:20 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:20.685120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:20.685761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:20.692023 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:20.692462 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:20.693231 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:20.693679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:20.754646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fa0fff5e-6c93-402e-b446-3dfbc927a4e6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:20.756546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fa0fff5e-6c93-402e-b446-3dfbc927a4e6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:20.764280 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa0fff5e-6c93-402e-b446-3dfbc927a4e6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:20.764824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa0fff5e-6c93-402e-b446-3dfbc927a4e6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:20.765843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa0fff5e-6c93-402e-b446-3dfbc927a4e6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:20.766260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa0fff5e-6c93-402e-b446-3dfbc927a4e6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:20.841502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fa0fff5e-6c93-402e-b446-3dfbc927a4e6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.090396 Nov 16 16:17:20.845707 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 236/421] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:20 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:20.846048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:20.852746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7d4333cc-dbc5-4951-9416-a4abc2775f89 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.171651 Nov 16 16:17:20.853252 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 186/422] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:20 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:21.018967 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:21.020295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:21.033665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.034123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:21.035011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.035540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:21.187008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:21.194866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0e0e8f12-5a7a-4093-8873-67ee72bfe65f tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.180189 Nov 16 16:17:21.195439 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 237/423] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:21 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:21.413998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:21.414632 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:21.421168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.421607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:21.422365 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.422817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:21.587937 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:21.596923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-16180b5e-1545-4516-8b3e-961d641a26bf tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.186992 Nov 16 16:17:21.597481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 187/424] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:21 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:21.858184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-676b8c6a-a259-445e-9d1b-3e3dd3a5f733 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:21.859816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-676b8c6a-a259-445e-9d1b-3e3dd3a5f733 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:21.869994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:21.870609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-676b8c6a-a259-445e-9d1b-3e3dd3a5f733 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.870609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-676b8c6a-a259-445e-9d1b-3e3dd3a5f733 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:21.870788 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:21.871336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-676b8c6a-a259-445e-9d1b-3e3dd3a5f733 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.871798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-676b8c6a-a259-445e-9d1b-3e3dd3a5f733 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:21.877231 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.877677 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:21.878478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:21.878911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:22.166182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:22.174423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4cf2a1de-d7ad-41d5-9dbb-f642f15da4e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.308231 Nov 16 16:17:22.175154 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 188/425] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:21 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:22.207964 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-676b8c6a-a259-445e-9d1b-3e3dd3a5f733 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.355778 Nov 16 16:17:22.209849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 238/426] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:21 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:22.212620 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:22.214058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:22.221445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:22.221979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:22.222918 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:22.223430 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:22.388379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:22.395925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-21499b63-ee4f-4f44-8866-b69b8af2620a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.188112 Nov 16 16:17:22.396483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 189/427] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:22 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:22.615349 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:22.616207 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:22.623344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:22.623792 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:22.624600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:22.625033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:22.771750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:22.779526 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-96165bd3-b5e0-40b6-8c6d-5bb512645978 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1521 microversion: 2.1 time: 0.168508 Nov 16 16:17:22.780118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 239/428] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:22 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:23.191730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:23.192306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:23.199283 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.199727 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.200497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.200928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.220680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f35c31e5-14be-4ec4-8ac1-196f971ccfbc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:23.221732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f35c31e5-14be-4ec4-8ac1-196f971ccfbc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:23.228380 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f35c31e5-14be-4ec4-8ac1-196f971ccfbc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.228862 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f35c31e5-14be-4ec4-8ac1-196f971ccfbc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.229700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f35c31e5-14be-4ec4-8ac1-196f971ccfbc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.230150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f35c31e5-14be-4ec4-8ac1-196f971ccfbc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.337087 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:23.344952 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3dc0da98-e1c7-48cb-9c9b-2cc9bff5e23f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.157091 Nov 16 16:17:23.346039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 190/429] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:23 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:23.414027 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:23.414819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:23.421021 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.421545 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.422465 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.423069 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.565391 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:23.576104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2b0ee30d-dedc-4933-ae2f-c22cfcdda41c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.165768 Nov 16 16:17:23.576779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 191/430] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:23 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:23.797540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:23.798147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:23.804812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.805256 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.806035 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.806516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.943143 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:23.951628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-17aa82ce-41c8-4c10-a1f8-b7a86a63bbff tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1501 microversion: 2.1 time: 0.157854 Nov 16 16:17:23.952220 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 192/431] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:23 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:23.960315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f35c31e5-14be-4ec4-8ac1-196f971ccfbc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.743678 Nov 16 16:17:23.961243 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 240/432] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:23 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:23.972270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:23.973225 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:23.979747 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.980193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:23.980960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:23.981393 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:24.127203 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:24.139463 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6bfa1da5-8397-442c-a7d1-e083ffc310e7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1516 microversion: 2.1 time: 0.172698 Nov 16 16:17:24.140398 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 193/433] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:23 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:24.363344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:24.364925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:24.372489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:24.372961 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:24.373822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:24.374469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:24.536648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:24.544335 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-06591095-34e1-4145-8bba-b36bf043901a tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.185162 Nov 16 16:17:24.545095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 241/434] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:24 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:24.596163 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:24.596747 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:24.603215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:24.603665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:24.604447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:24.604878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:24.743199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:24.754847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-629af8af-e7c6-44de-ad9d-2f89ff5cf5e2 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.161945 Nov 16 16:17:24.756645 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 194/435] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:24 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:24.976830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b2b445a5-0a8d-443c-9d01-b2c52412e736 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:24.978445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b2b445a5-0a8d-443c-9d01-b2c52412e736 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:24.989527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2b445a5-0a8d-443c-9d01-b2c52412e736 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:24.989972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2b445a5-0a8d-443c-9d01-b2c52412e736 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:24.990822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2b445a5-0a8d-443c-9d01-b2c52412e736 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:24.991250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2b445a5-0a8d-443c-9d01-b2c52412e736 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:25.561124 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:25.561756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:25.568209 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:25.568649 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:25.569395 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:25.569833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:25.726991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:25.735589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b06e447d-d872-4a71-a98a-c8e5339fcc1e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.178007 Nov 16 16:17:25.736079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 195/436] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:25 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:25.777767 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:25.778407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:25.784918 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:25.785470 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:25.786506 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:25.786947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:25.925266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:25.932759 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-84d3597a-dc89-49e0-9fb4-cdeff2eb727a tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.158839 Nov 16 16:17:25.933326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 196/437] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:25 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:26.753785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:26.754676 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:26.761689 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:26.762334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:26.763168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:26.763598 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:26.896808 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:26.905298 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-414ef6a2-8747-4e99-836a-0183b84a2a75 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.155690 Nov 16 16:17:26.906018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 197/438] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:26 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:26.949381 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:26.950301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:26.960000 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:26.960631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:26.961856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:26.962832 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:27.109097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:27.117357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3c35584f-d322-4621-adb5-16b7e661671b tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.172081 Nov 16 16:17:27.117914 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 198/439] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:26 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:27.926954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:27.927823 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:27.935978 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:27.936545 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:27.937508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:27.938061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:28.077733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:28.087070 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f7319aff-5a66-4fb0-9661-e3604ac2baec tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.166682 Nov 16 16:17:28.087647 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 199/440] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:27 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:28.134858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:28.135487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:28.141579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:28.142033 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:28.142838 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:28.143272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:28.282114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:28.289730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-72149c70-594c-435f-9f3a-5ed75b94e5f1 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.158474 Nov 16 16:17:28.290297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 200/441] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:28 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:29.104273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:29.104896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:29.111387 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:29.111913 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:29.112891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:29.113366 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:29.120290 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b2b445a5-0a8d-443c-9d01-b2c52412e736 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 4.150049 Nov 16 16:17:29.125568 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 242/442] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:24 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 4156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:29.248040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:29.255705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6d36a309-934a-4817-b496-77cd9fbc1c3e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.155326 Nov 16 16:17:29.256261 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 201/443] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:29 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:29.307061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:29.307845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:29.315731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:29.316166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:29.317207 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:29.317760 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:29.447297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:29.455164 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2c707446-0fc6-455d-ae65-1e03ef457fff tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.152119 Nov 16 16:17:29.455730 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 243/444] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:29 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:30.133545 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4923e49d-b803-4706-bb3d-77ae0ad16b88 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:30.134721 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4923e49d-b803-4706-bb3d-77ae0ad16b88 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:30.142356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4923e49d-b803-4706-bb3d-77ae0ad16b88 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:30.142841 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4923e49d-b803-4706-bb3d-77ae0ad16b88 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:30.143708 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4923e49d-b803-4706-bb3d-77ae0ad16b88 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:30.144147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4923e49d-b803-4706-bb3d-77ae0ad16b88 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:30.273992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:30.274629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:30.281844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:30.282287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:30.283102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:30.283530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:30.371056 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4923e49d-b803-4706-bb3d-77ae0ad16b88 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.241658 Nov 16 16:17:30.371711 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 202/445] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:30 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:30.428398 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:30.436327 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4ff724c9-b084-4d85-8367-0b84b05de441 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.166805 Nov 16 16:17:30.436945 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 244/446] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:30 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:30.473039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:30.473856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:30.481572 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:30.482013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:30.482807 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:30.483241 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:30.623873 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:30.632373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cb9f6360-58a3-4724-8e2c-b6f8963fbea8 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.163350 Nov 16 16:17:30.637784 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 203/447] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:30 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:31.382814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a87dcb2c-6df4-48e7-b6f2-ff1519503567 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:31.383750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a87dcb2c-6df4-48e7-b6f2-ff1519503567 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:31.390095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87dcb2c-6df4-48e7-b6f2-ff1519503567 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:31.390642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87dcb2c-6df4-48e7-b6f2-ff1519503567 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:31.391420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87dcb2c-6df4-48e7-b6f2-ff1519503567 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:31.391851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a87dcb2c-6df4-48e7-b6f2-ff1519503567 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:31.456991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:31.457768 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:31.465259 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:31.465704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:31.466511 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:31.466943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:31.470757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a87dcb2c-6df4-48e7-b6f2-ff1519503567 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.091403 Nov 16 16:17:31.471518 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 245/448] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:31 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:31.622540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:31.631136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-939ea4c9-a5ee-48c0-80f5-92917d2cbd3f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.179907 Nov 16 16:17:31.631725 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 204/449] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:31 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:31.651733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:31.652624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:31.660384 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:31.661135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:31.662265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:31.663804 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:31.764135 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-e517a601-4650-486b-85f3-4960d52ac0ca req-1479f587-4a34-421f-b6e4-a7f36691608a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a69b9f-26ec-45c2-bdd8-8e38efeb110f", "name": "network-vif-plugged", "status": "completed", "tag": "edf6e728-1de4-4548-a79d-1bb26d3dd900"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:31.765793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:17:31.765793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:17:31.774497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-e517a601-4650-486b-85f3-4960d52ac0ca req-1479f587-4a34-421f-b6e4-a7f36691608a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:31.775010 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-e517a601-4650-486b-85f3-4960d52ac0ca req-1479f587-4a34-421f-b6e4-a7f36691608a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:31.788688 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-e517a601-4650-486b-85f3-4960d52ac0ca req-1479f587-4a34-421f-b6e4-a7f36691608a service nova] Creating event network-vif-plugged:edf6e728-1de4-4548-a79d-1bb26d3dd900 for instance 28a69b9f-26ec-45c2-bdd8-8e38efeb110f on hv-cinder-78776 Nov 16 16:17:31.793775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-e517a601-4650-486b-85f3-4960d52ac0ca req-1479f587-4a34-421f-b6e4-a7f36691608a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033377 Nov 16 16:17:31.794581 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 205/450] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:17:31.827382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:31.846569 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cc00e519-5665-4c24-aeb9-40cc3397ff40 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.199769 Nov 16 16:17:31.847344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 246/451] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:31 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:32.484421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9ba16709-4081-401d-9873-7405869cfd44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:32.485448 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9ba16709-4081-401d-9873-7405869cfd44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:32.491814 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ba16709-4081-401d-9873-7405869cfd44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.492266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ba16709-4081-401d-9873-7405869cfd44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.493039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ba16709-4081-401d-9873-7405869cfd44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.493475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ba16709-4081-401d-9873-7405869cfd44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.586741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9ba16709-4081-401d-9873-7405869cfd44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.106601 Nov 16 16:17:32.587424 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 206/452] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:32 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:32.653650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:32.654322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:32.663655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.664102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.664853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.665283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.806954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:32.814615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9a625d8b-348d-4fd0-9c98-8579b0cd058d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.168377 Nov 16 16:17:32.815359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 247/453] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:32 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:32.864578 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:32.865282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:32.872373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.872804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.873596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.874036 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.895570 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:32.896505 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:32.902770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.903213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.903984 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:32.904413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:32.927473 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lazy-loading 'flavor' on Instance uuid ca96c22d-d0ae-48e0-9f0f-fa02d0324fec {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:17:33.014362 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:33.022733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-aece9c84-6627-4aeb-acc3-3a71efc275bd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.162418 Nov 16 16:17:33.023310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 207/454] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:32 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:33.038718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-222d847a-2f21-4006-bb9d-b209f0c6c1cc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action" status: 200 len: 32 microversion: 2.1 time: 0.146510 Nov 16 16:17:33.039554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 248/455] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:32 2021] POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:17:33.048961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:33.049582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:33.055854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:33.056303 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:33.057105 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:33.057604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:33.195001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:33.202789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1d088e6d-ec10-4c88-8128-9ee83a7779cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.157934 Nov 16 16:17:33.203411 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 208/456] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:33 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:33.599506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5fa93358-4a66-42c1-84c0-9353edfc1558 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:33.600513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5fa93358-4a66-42c1-84c0-9353edfc1558 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:33.607901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5fa93358-4a66-42c1-84c0-9353edfc1558 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:33.608360 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5fa93358-4a66-42c1-84c0-9353edfc1558 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:33.609138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5fa93358-4a66-42c1-84c0-9353edfc1558 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:33.609661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5fa93358-4a66-42c1-84c0-9353edfc1558 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:33.757976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5fa93358-4a66-42c1-84c0-9353edfc1558 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.162527 Nov 16 16:17:33.758775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 249/457] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:33 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:33.816597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-e296fc38-4022-40bf-a0a7-539abec035ed req-ae0c2f25-312a-44fb-9dc6-dbecf705865b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fbcda0-44c4-45be-9b1f-96d4eceda3d8", "name": "network-vif-plugged", "status": "completed", "tag": "abdeea90-028a-4b7a-9617-51b8c519f3d5"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:33.818251 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:17:33.818251 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:17:33.832657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:33.833413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:33.838077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-e296fc38-4022-40bf-a0a7-539abec035ed req-ae0c2f25-312a-44fb-9dc6-dbecf705865b service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:33.841434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:33.841886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:33.842800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:33.843189 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:33.848725 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-e296fc38-4022-40bf-a0a7-539abec035ed req-ae0c2f25-312a-44fb-9dc6-dbecf705865b service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:33.868039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-e296fc38-4022-40bf-a0a7-539abec035ed req-ae0c2f25-312a-44fb-9dc6-dbecf705865b service nova] Creating event network-vif-plugged:abdeea90-028a-4b7a-9617-51b8c519f3d5 for instance 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 on hv-cinder-78776 Nov 16 16:17:33.879066 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-e296fc38-4022-40bf-a0a7-539abec035ed req-ae0c2f25-312a-44fb-9dc6-dbecf705865b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066737 Nov 16 16:17:33.879875 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 209/458] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:34.014068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:34.022509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ab9ceb78-9b6f-4b50-b4bd-59791c6f2866 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.193823 Nov 16 16:17:34.023420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 250/459] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:33 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:34.041083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:34.041958 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:34.048983 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:34.049557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:34.050404 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:34.050849 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:34.198605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:34.207437 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-150658cc-2567-45b0-a8ca-faccce11698e tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1313 microversion: 2.1 time: 0.170710 Nov 16 16:17:34.208060 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 210/460] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:34 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:34.221666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:34.222403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:34.229062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:34.229512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:34.230295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:34.230748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:34.366348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:34.374356 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-aa46fb90-b77c-41ea-ad06-893e1d08b4ca tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.156767 Nov 16 16:17:34.375064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 251/461] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:34 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:34.773946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-119c7847-9cb9-4e0f-a242-886af42051d5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:34.775650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-119c7847-9cb9-4e0f-a242-886af42051d5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:34.786133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-119c7847-9cb9-4e0f-a242-886af42051d5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:34.786730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-119c7847-9cb9-4e0f-a242-886af42051d5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:34.787630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-119c7847-9cb9-4e0f-a242-886af42051d5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:34.788119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-119c7847-9cb9-4e0f-a242-886af42051d5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:34.889198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-119c7847-9cb9-4e0f-a242-886af42051d5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.122290 Nov 16 16:17:34.889871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 211/462] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:34 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:17:35.040027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:35.040699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:35.047909 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.048363 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.049177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.049660 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.191357 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:35.199194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-680e0bfb-7050-43fb-89ef-4c2044ccab46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.163531 Nov 16 16:17:35.199774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 252/463] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:35 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:35.225592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:35.226292 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:35.233386 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.233860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.234898 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.235400 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.387955 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:35.394094 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-937e64f3-03a0-4b41-97a5-16d37be04e16 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1498 microversion: 2.1 time: 0.172775 Nov 16 16:17:35.394244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:35.395151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 212/464] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:35 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:35.395298 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:35.403390 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.404032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.405608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.406069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.551948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:35.560039 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-69258a7c-6d1b-414b-b806-4e3f48bebc3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.171175 Nov 16 16:17:35.560579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 253/465] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:35 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:35.777524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-92e39947-594e-433b-bd2c-46d5f08f3f12 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50f6fa75-2646-4f86-9220-78a1e6df4c44", "device": "/dev/sdb"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:35.779231 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-92e39947-594e-433b-bd2c-46d5f08f3f12 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:35.785813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e39947-594e-433b-bd2c-46d5f08f3f12 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.786522 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e39947-594e-433b-bd2c-46d5f08f3f12 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.787470 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e39947-594e-433b-bd2c-46d5f08f3f12 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.787892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92e39947-594e-433b-bd2c-46d5f08f3f12 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.901333 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5246a495-e091-433b-81f1-7f920ea8b72a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:35.902280 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5246a495-e091-433b-81f1-7f920ea8b72a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:35.908948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5246a495-e091-433b-81f1-7f920ea8b72a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.909407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5246a495-e091-433b-81f1-7f920ea8b72a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:35.910472 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5246a495-e091-433b-81f1-7f920ea8b72a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:35.910862 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5246a495-e091-433b-81f1-7f920ea8b72a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.012553 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5246a495-e091-433b-81f1-7f920ea8b72a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.115195 Nov 16 16:17:36.013072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 254/466] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:35 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:17:36.090794 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-92e39947-594e-433b-bd2c-46d5f08f3f12 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "POST /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317124 Nov 16 16:17:36.091410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 213/467] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:17:35 2021] POST /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:36.114058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:36.115099 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:36.122134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.122616 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.123394 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.123814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.154047 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:17:36.218572 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:36.219345 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:36.226559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.227253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.228157 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.228666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.231859 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cfecad6e-4128-44dd-811b-e34fe2878188 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "DELETE /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 204 len: 0 microversion: 2.1 time: 0.121705 Nov 16 16:17:36.232443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 255/468] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:17:36 2021] DELETE /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:17:36.241737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:36.242407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:36.249013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.249454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.250256 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.250713 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.437715 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:36.446476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55a43988-495b-4cd7-9a5b-130b4cc01178 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1318 microversion: 2.1 time: 0.232959 Nov 16 16:17:36.447416 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 214/469] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:36 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:36.449702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:36.458564 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-dcbd0b64-0eef-43a1-a56e-99cae700c8cd tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1504 microversion: 2.1 time: 0.221187 Nov 16 16:17:36.468549 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 256/470] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:36 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:36.577293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:36.577926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:36.584713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.585163 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.585917 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:36.586414 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:36.731663 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:36.739453 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e9989d3a-e486-4496-b0b5-334753d4bba7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.166029 Nov 16 16:17:36.740223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 215/471] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:36 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:37.028973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-13debe3f-67dc-40eb-8320-23353c0b8efa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:37.030446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-13debe3f-67dc-40eb-8320-23353c0b8efa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:37.040320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13debe3f-67dc-40eb-8320-23353c0b8efa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.040923 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13debe3f-67dc-40eb-8320-23353c0b8efa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.041809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13debe3f-67dc-40eb-8320-23353c0b8efa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.042300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13debe3f-67dc-40eb-8320-23353c0b8efa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.152976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-13debe3f-67dc-40eb-8320-23353c0b8efa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.130465 Nov 16 16:17:37.153851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 257/472] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:37 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:37.467908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:37.468724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:37.479477 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.480195 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:37.480428 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.481396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:37.481772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.482535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.492135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.492608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.493418 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.493845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.684993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:37.692833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ff997412-6f39-4946-9907-5220344dfeef tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1509 microversion: 2.1 time: 0.231152 Nov 16 16:17:37.693790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:37.694099 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 216/473] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:37 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1509 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:37.702728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a6b1869d-24d0-4998-a492-b5b66b3d28c9 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1504 microversion: 2.1 time: 0.229627 Nov 16 16:17:37.704667 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 258/474] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:37 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:37.757244 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:37.757850 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:37.764631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.765313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.766564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:37.767044 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:37.960716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:37.975647 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-371da73a-d022-4f7e-85b6-9d03f3170cb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.216227 Nov 16 16:17:37.975647 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 217/475] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:37 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:38.166512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e8bf44c5-7322-4694-8a56-4d5f41ad7bdb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:38.168118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e8bf44c5-7322-4694-8a56-4d5f41ad7bdb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:38.175104 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e8bf44c5-7322-4694-8a56-4d5f41ad7bdb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:38.175538 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e8bf44c5-7322-4694-8a56-4d5f41ad7bdb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:38.176603 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e8bf44c5-7322-4694-8a56-4d5f41ad7bdb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:38.177103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e8bf44c5-7322-4694-8a56-4d5f41ad7bdb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:38.309681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e8bf44c5-7322-4694-8a56-4d5f41ad7bdb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.147522 Nov 16 16:17:38.314599 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 259/476] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:38 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:38.719562 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:38.720443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:38.728766 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:38.729215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:38.730602 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:38.731123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:38.869101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:38.876730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fb5485dd-d38a-4ae6-b800-a87bc055cf37 tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1504 microversion: 2.1 time: 0.160805 Nov 16 16:17:38.877467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 218/477] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:38 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:38.987724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:38.988312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:38.995301 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:38.995732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:38.996497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:38.996916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:39.140193 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:39.148531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-02648929-67bb-4e00-9447-4d53a791528b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.164821 Nov 16 16:17:39.149839 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 260/478] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:38 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:39.321918 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-baf4a59a-ff4f-4395-863c-40b84543f464 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:39.323057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-baf4a59a-ff4f-4395-863c-40b84543f464 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:39.330142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-baf4a59a-ff4f-4395-863c-40b84543f464 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:39.330806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-baf4a59a-ff4f-4395-863c-40b84543f464 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:39.331750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-baf4a59a-ff4f-4395-863c-40b84543f464 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:39.332171 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-baf4a59a-ff4f-4395-863c-40b84543f464 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:39.434094 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-baf4a59a-ff4f-4395-863c-40b84543f464 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.116239 Nov 16 16:17:39.434791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 219/479] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:39 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:39.803156 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-ce18fb1a-26d1-445c-8e1b-c9a6cedbf702 req-74683e99-83aa-410f-acc4-1d7cb615a205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a69b9f-26ec-45c2-bdd8-8e38efeb110f", "name": "network-vif-deleted", "tag": "edf6e728-1de4-4548-a79d-1bb26d3dd900"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:39.804906 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:17:39.804906 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:17:39.813639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-ce18fb1a-26d1-445c-8e1b-c9a6cedbf702 req-74683e99-83aa-410f-acc4-1d7cb615a205 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:39.814007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-ce18fb1a-26d1-445c-8e1b-c9a6cedbf702 req-74683e99-83aa-410f-acc4-1d7cb615a205 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:39.825907 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-ce18fb1a-26d1-445c-8e1b-c9a6cedbf702 req-74683e99-83aa-410f-acc4-1d7cb615a205 service nova] Creating event network-vif-deleted:edf6e728-1de4-4548-a79d-1bb26d3dd900 for instance 28a69b9f-26ec-45c2-bdd8-8e38efeb110f on hv-cinder-78776 Nov 16 16:17:39.830988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-ce18fb1a-26d1-445c-8e1b-c9a6cedbf702 req-74683e99-83aa-410f-acc4-1d7cb615a205 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031605 Nov 16 16:17:39.831618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 261/480] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:17:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:39.895096 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:39.895858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:39.903417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:39.903861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:39.904643 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:39.905075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:39.936596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:39.937057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:39.938069 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lazy-loading 'fault' on Instance uuid 28a69b9f-26ec-45c2-bdd8-8e38efeb110f {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:17:39.984746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eea5bfe0bcfa4568986c6362ecfbe19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba4d0c4ca68d4ce0bb5542957d6c2874', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:39.994471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5e97f78e-b8d8-4b1f-a6af-77c272dc040c tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 200 len: 1303 microversion: 2.1 time: 0.103621 Nov 16 16:17:39.995103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 220/481] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:39 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:40.165536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:40.166116 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-39453675-0930-4068-90db-fcb9046fcf2f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad2ebb6c-5026-4e5c-9ace-280c90f4a5f5"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:40.166416 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:40.167497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-39453675-0930-4068-90db-fcb9046fcf2f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:40.174482 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:40.174693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39453675-0930-4068-90db-fcb9046fcf2f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:40.174928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:40.175038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39453675-0930-4068-90db-fcb9046fcf2f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:40.175696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39453675-0930-4068-90db-fcb9046fcf2f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:40.175793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:40.176117 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39453675-0930-4068-90db-fcb9046fcf2f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:40.176226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:40.313945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:40.321864 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-15bc6e23-3c2b-47de-9c2b-b1edbe459739 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.160621 Nov 16 16:17:40.322449 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 221/482] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:40 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:40.447512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fc4742c4-2e63-47d6-b49b-60c23ac1859e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:40.448618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fc4742c4-2e63-47d6-b49b-60c23ac1859e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:40.456259 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4742c4-2e63-47d6-b49b-60c23ac1859e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:40.456855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4742c4-2e63-47d6-b49b-60c23ac1859e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:40.457899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4742c4-2e63-47d6-b49b-60c23ac1859e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:40.458544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4742c4-2e63-47d6-b49b-60c23ac1859e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:40.461486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-39453675-0930-4068-90db-fcb9046fcf2f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298684 Nov 16 16:17:40.462722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 262/483] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:17:40 2021] POST /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:17:40.590413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fc4742c4-2e63-47d6-b49b-60c23ac1859e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.147850 Nov 16 16:17:40.594481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 222/484] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:40 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:17:41.017752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:41.018549 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] [instance: 28a69b9f-26ec-45c2-bdd8-8e38efeb110f] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:41.026052 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:41.026535 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:41.027317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:41.027748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:41.042739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] HTTP exception thrown: Instance 28a69b9f-26ec-45c2-bdd8-8e38efeb110f could not be found. Nov 16 16:17:41.043348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] Returning 404 to user: Instance 28a69b9f-26ec-45c2-bdd8-8e38efeb110f could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:17:41.044204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3fa01e9d-2bad-47b4-b448-33f48c9d60cf tempest-VolumesActionsTest-1660574012 tempest-VolumesActionsTest-1660574012-project] 10.222.0.61 "GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f" status: 404 len: 111 microversion: 2.1 time: 0.030666 Nov 16 16:17:41.044727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 263/485] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:41 2021] GET /compute/v2.1/servers/28a69b9f-26ec-45c2-bdd8-8e38efeb110f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:17:41.339162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:41.339853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:41.348419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:41.348872 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:41.349658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:41.350098 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:41.495600 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:41.503232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eb2355c8-4bea-4fcf-89a5-a70535c7a9d7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.168156 Nov 16 16:17:41.503801 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 223/486] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:41 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:41.602952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-77d5ea6f-b19d-45de-a073-6d5c177ad07f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:41.603792 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-77d5ea6f-b19d-45de-a073-6d5c177ad07f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:41.611015 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77d5ea6f-b19d-45de-a073-6d5c177ad07f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:41.611459 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77d5ea6f-b19d-45de-a073-6d5c177ad07f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:41.612235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77d5ea6f-b19d-45de-a073-6d5c177ad07f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:41.612824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77d5ea6f-b19d-45de-a073-6d5c177ad07f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:41.709459 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-77d5ea6f-b19d-45de-a073-6d5c177ad07f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.110415 Nov 16 16:17:41.711456 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 264/487] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:41 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:42.521218 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:42.522168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:42.529260 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:42.529707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:42.530493 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:42.530919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:42.668172 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:42.675536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-aa9309a9-9da6-4c45-932a-608ea4a2f6b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.158097 Nov 16 16:17:42.676079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 224/488] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:42 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:42.721809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e716c324-71e3-4c88-b5de-22237a177b73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:42.722839 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e716c324-71e3-4c88-b5de-22237a177b73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:42.730098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e716c324-71e3-4c88-b5de-22237a177b73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:42.730592 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e716c324-71e3-4c88-b5de-22237a177b73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:42.731380 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e716c324-71e3-4c88-b5de-22237a177b73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:42.731823 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e716c324-71e3-4c88-b5de-22237a177b73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:43.070806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e716c324-71e3-4c88-b5de-22237a177b73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.352863 Nov 16 16:17:43.071732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 265/489] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:42 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:43.692961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:43.693883 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:43.700542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:43.700993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:43.701786 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:43.702220 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:43.847207 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:43.855963 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5a3dbb52-6bf7-41d1-a092-86672b236ce7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.166796 Nov 16 16:17:43.856505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 225/490] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:43 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:44.088942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e9b2404e-b7b2-4f0f-ab28-04ed739d25ed tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:44.090600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e9b2404e-b7b2-4f0f-ab28-04ed739d25ed tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:44.101489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9b2404e-b7b2-4f0f-ab28-04ed739d25ed tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:44.101938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9b2404e-b7b2-4f0f-ab28-04ed739d25ed tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:44.102761 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9b2404e-b7b2-4f0f-ab28-04ed739d25ed tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:44.103197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9b2404e-b7b2-4f0f-ab28-04ed739d25ed tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:44.873254 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:44.873815 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:44.880682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:44.881130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:44.881910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:44.882342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:45.016991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:45.026410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e8c6845a-eb95-4b76-adc2-3108c9f56289 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.156856 Nov 16 16:17:45.027079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 226/491] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:44 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:46.047277 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:46.048293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:46.056478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:46.056922 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:46.057698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:46.058129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:46.193596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:46.201439 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7182b817-7328-4bde-8f44-048a56a994be tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.160272 Nov 16 16:17:46.202018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 227/492] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:46 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:47.222821 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:47.223861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:47.233396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e9b2404e-b7b2-4f0f-ab28-04ed739d25ed tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 3.150960 Nov 16 16:17:47.239818 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:47.239986 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 266/493] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:44 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 3155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:47.240086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:47.240086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:47.240086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:47.374875 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:47.382936 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3f395ef2-3e55-4738-b63b-d5740151b2c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.166424 Nov 16 16:17:47.383512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 228/494] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:47 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:48.249448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-79003bf3-65bb-4386-a67b-9fe836014a1d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:48.250795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-79003bf3-65bb-4386-a67b-9fe836014a1d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:48.260861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79003bf3-65bb-4386-a67b-9fe836014a1d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:48.261389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79003bf3-65bb-4386-a67b-9fe836014a1d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:48.262293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79003bf3-65bb-4386-a67b-9fe836014a1d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:48.262858 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79003bf3-65bb-4386-a67b-9fe836014a1d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:48.406288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:48.406924 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:48.413524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:48.413965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:48.414776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:48.415210 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:48.561088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:48.568738 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2673dd1e-ae2f-4335-a2de-c6515ff58538 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.166102 Nov 16 16:17:48.569309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 229/495] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:48 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:49.587652 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:49.588409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:49.596223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:49.596744 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:49.597653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:49.598165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:49.745743 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:49.757309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b0e7c862-5595-488e-b98e-58459d094f77 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.174170 Nov 16 16:17:49.758086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 230/496] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:49 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:50.783060 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:50.784123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:50.792364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:50.792811 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:50.793610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:50.794040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:50.928516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:50.936272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9b49e4ed-1523-4932-be96-f02825f031e5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.159561 Nov 16 16:17:50.936856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 231/497] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:50 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:51.956451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:51.957126 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:51.965323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:51.965758 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:51.966559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:51.966985 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:52.107485 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:52.114871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-737a9de3-603f-4ba4-a9df-c5fca89f412c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.164582 Nov 16 16:17:52.115557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 232/498] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:51 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:53.133083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:53.133729 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:53.140633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:53.141072 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:53.141877 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:53.142307 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:53.145381 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-79003bf3-65bb-4386-a67b-9fe836014a1d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 4.900854 Nov 16 16:17:53.146017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 267/499] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:48 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 4903 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:53.280451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:53.287950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-84028b2f-282b-4e3b-b8b8-0e8ab9cf873c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.158741 Nov 16 16:17:53.288525 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 233/500] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:53 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:54.159372 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c6602d38-eb2c-497e-ad91-a9038ad4a4d9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:54.160579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c6602d38-eb2c-497e-ad91-a9038ad4a4d9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:54.168996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c6602d38-eb2c-497e-ad91-a9038ad4a4d9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:54.169429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c6602d38-eb2c-497e-ad91-a9038ad4a4d9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:54.170213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c6602d38-eb2c-497e-ad91-a9038ad4a4d9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:54.170680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c6602d38-eb2c-497e-ad91-a9038ad4a4d9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:54.236291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c6602d38-eb2c-497e-ad91-a9038ad4a4d9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.080798 Nov 16 16:17:54.240290 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 268/501] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:54 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:54.307291 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:54.308344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:54.316331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:54.316772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:54.317573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:54.318003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:54.453973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:54.461237 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6375385b-2f3a-487f-9637-013ca3d2246e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.159839 Nov 16 16:17:54.461801 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 234/502] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:54 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:55.248922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c51bc813-169b-404e-8fa6-21e9fe525cd1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:17:55.250146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c51bc813-169b-404e-8fa6-21e9fe525cd1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:55.257768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c51bc813-169b-404e-8fa6-21e9fe525cd1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:55.258646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c51bc813-169b-404e-8fa6-21e9fe525cd1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:55.259444 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c51bc813-169b-404e-8fa6-21e9fe525cd1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:55.259878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c51bc813-169b-404e-8fa6-21e9fe525cd1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:55.478835 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:55.479585 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:55.486651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:55.487104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:55.487883 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:55.488321 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:55.629302 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:55.637617 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-004e2cf0-775f-4670-95d1-d5120d63dbed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.162623 Nov 16 16:17:55.638103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 235/503] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:55 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:56.655549 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:56.656266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:56.663275 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:56.663751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:56.664660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:56.665198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:56.814017 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:56.821871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8599a8e2-2ff7-4a4e-b8de-88154ae36c81 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.170252 Nov 16 16:17:56.822502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 236/504] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:56 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:17:57.840683 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:57.841398 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:57.848058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:57.848509 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:57.849294 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:57.849718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:58.005081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:58.013194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c4fd53ba-219f-4a01-93d3-737f3f5564b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.176359 Nov 16 16:17:58.013755 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 237/505] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:57 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:17:59.034631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:17:59.035657 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:17:59.044485 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:59.044932 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:59.045713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:17:59.046145 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:17:59.161927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c51bc813-169b-404e-8fa6-21e9fe525cd1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 3.917038 Nov 16 16:17:59.162524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 269/506] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:17:55 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 3919 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:17:59.185571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:17:59.196182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ee1db32c-4b80-4a1b-87b2-c13d2b62d3a6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.167898 Nov 16 16:17:59.197017 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 238/507] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:17:59 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:00.175714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bef3b8bd-9264-4bd6-8426-e373af876ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:00.176916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bef3b8bd-9264-4bd6-8426-e373af876ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:00.187307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bef3b8bd-9264-4bd6-8426-e373af876ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:00.187736 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bef3b8bd-9264-4bd6-8426-e373af876ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:00.188503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bef3b8bd-9264-4bd6-8426-e373af876ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:00.188926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bef3b8bd-9264-4bd6-8426-e373af876ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:00.217573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:00.218136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:00.224946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:00.225389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:00.226182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:00.226648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:00.264132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bef3b8bd-9264-4bd6-8426-e373af876ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.093527 Nov 16 16:18:00.264797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 270/508] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:00 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:00.369214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:00.377779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ace4ea38-53aa-40ab-80eb-4a8168a41001 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.163947 Nov 16 16:18:00.378359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 239/509] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:00 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:01.278790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fb1eb74e-1124-4f61-b205-e2ab5708c584 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:01.280027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fb1eb74e-1124-4f61-b205-e2ab5708c584 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:01.288744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb1eb74e-1124-4f61-b205-e2ab5708c584 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:01.289296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb1eb74e-1124-4f61-b205-e2ab5708c584 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:01.290334 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb1eb74e-1124-4f61-b205-e2ab5708c584 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:01.290913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb1eb74e-1124-4f61-b205-e2ab5708c584 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:01.397395 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:01.397979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:01.405079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:01.405529 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:01.406299 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:01.406765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:01.560836 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:01.569010 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-402f498f-e975-41b8-8f28-b55af29bf359 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.175674 Nov 16 16:18:01.569588 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 240/510] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:01 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:02.586297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:02.587000 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:02.593321 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:02.593756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:02.594551 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:02.594979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:02.726759 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:02.734988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-932cf22a-44ee-4a36-a9e7-57edf5d198f5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.152601 Nov 16 16:18:02.735554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 241/511] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:02 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:03.753812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:03.754718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:03.763856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:03.764425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:03.765259 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:03.765755 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:03.927230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:03.936288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-01b7ad33-6f9d-42bf-af40-36645c4e6c2e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.186460 Nov 16 16:18:03.936881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 242/512] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:03 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:18:04.695227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fb1eb74e-1124-4f61-b205-e2ab5708c584 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 3.421083 Nov 16 16:18:04.696942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 271/513] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:01 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 3424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:04.957175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:04.957789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:04.964974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:04.965411 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:04.966487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:04.966966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:05.100103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:05.107833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-81370a26-41a7-4f2e-a9ce-d2b0e954a35f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.154236 Nov 16 16:18:05.108372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 243/514] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:04 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:05.715300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-77143b5a-e1e2-4cc3-924a-6d007a9847c6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:05.717181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-77143b5a-e1e2-4cc3-924a-6d007a9847c6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:05.730148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77143b5a-e1e2-4cc3-924a-6d007a9847c6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:05.730942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77143b5a-e1e2-4cc3-924a-6d007a9847c6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:05.732213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77143b5a-e1e2-4cc3-924a-6d007a9847c6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:05.732641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77143b5a-e1e2-4cc3-924a-6d007a9847c6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:05.806336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-77143b5a-e1e2-4cc3-924a-6d007a9847c6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 0.098896 Nov 16 16:18:05.807021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 272/515] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:05 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:06.125508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:06.126121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:06.132318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:06.132762 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:06.133536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:06.133956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:06.282886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:06.291922 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d5062599-5921-4c1a-803e-5a428e316f6d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.170324 Nov 16 16:18:06.292527 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 244/516] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:06 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:06.819900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3de89f26-3de0-4cb0-b07f-0e67c6dc197a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:06.821067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3de89f26-3de0-4cb0-b07f-0e67c6dc197a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:06.829481 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3de89f26-3de0-4cb0-b07f-0e67c6dc197a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:06.829919 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3de89f26-3de0-4cb0-b07f-0e67c6dc197a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:06.830741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3de89f26-3de0-4cb0-b07f-0e67c6dc197a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:06.831172 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3de89f26-3de0-4cb0-b07f-0e67c6dc197a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:07.314939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:07.315554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:07.321889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:07.322745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:07.323888 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:07.324324 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:07.458244 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:07.465693 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e51144ac-ba0c-4d28-b4d7-4ea3a0c464c0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.158141 Nov 16 16:18:07.466293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 245/517] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:07 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:08.482861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:08.483459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:08.490344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:08.490830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:08.491610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:08.492045 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:08.639574 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:08.648328 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f111520e-ff6d-4775-b6fa-026907b55c36 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.169252 Nov 16 16:18:08.648938 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 246/518] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:08 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:09.668147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:09.669140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:09.679440 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:09.680122 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:09.681322 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:09.681988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:09.822118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:09.830192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9a123c6f-8a0f-4b4c-bc55-88983a5e3c48 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.167825 Nov 16 16:18:09.830825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 247/519] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:09 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:10.851795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:10.852873 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:10.862827 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:10.863272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:10.864041 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:10.864458 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:11.004471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:11.012493 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a6b660c1-0a8c-4697-b831-96eba34b2c9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.167255 Nov 16 16:18:11.013093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 248/520] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:10 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:11.663426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3de89f26-3de0-4cb0-b07f-0e67c6dc197a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28277 microversion: 2.1 time: 4.847722 Nov 16 16:18:11.665023 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 273/521] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:06 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28277 bytes in 4850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:12.031099 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:12.032383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:12.039540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:12.040266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:12.041305 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:12.041751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:12.412269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:12.420536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bf57f703-cdc3-4094-a717-10bd79d4adb6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.393463 Nov 16 16:18:12.421349 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 249/522] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:12 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:12.679110 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-47b60492-dc46-472a-8f11-c5f7c0038905 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:12.681072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-47b60492-dc46-472a-8f11-c5f7c0038905 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:12.694163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47b60492-dc46-472a-8f11-c5f7c0038905 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:12.694635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47b60492-dc46-472a-8f11-c5f7c0038905 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:12.699863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47b60492-dc46-472a-8f11-c5f7c0038905 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:12.700257 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47b60492-dc46-472a-8f11-c5f7c0038905 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:12.818285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-47b60492-dc46-472a-8f11-c5f7c0038905 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28568 microversion: 2.1 time: 0.144064 Nov 16 16:18:12.825332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 274/523] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:12 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:13.440309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:13.441381 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:13.453323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:13.454179 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:13.455446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:13.456202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:13.638526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:13.649343 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5ba9a0e6-4972-4103-8e93-0eacbda6dc54 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.215435 Nov 16 16:18:13.660626 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 250/524] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:13 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:18:13.834568 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9c8775f1-8965-4ab0-b9bc-2975f7db148d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:13.835948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9c8775f1-8965-4ab0-b9bc-2975f7db148d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:13.844503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c8775f1-8965-4ab0-b9bc-2975f7db148d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:13.847362 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c8775f1-8965-4ab0-b9bc-2975f7db148d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:13.851468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c8775f1-8965-4ab0-b9bc-2975f7db148d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:13.852617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c8775f1-8965-4ab0-b9bc-2975f7db148d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:14.677076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:14.677709 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:14.685211 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:14.685656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:14.686481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:14.687114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:14.848115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:14.856879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5f89b7f3-9c22-45d1-9551-3b891af6e91a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.184055 Nov 16 16:18:14.857450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 251/525] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:14 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:15.877560 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:15.878782 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:15.888310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:15.889188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:15.890208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:15.890671 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:16.072443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:16.080633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2ee48945-9bf0-4b79-97f6-10522f0a8245 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.210069 Nov 16 16:18:16.081496 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 252/526] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:15 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:18:17.097854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:17.098745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:17.104980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:17.105732 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:17.106929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:17.107513 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:17.255664 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:17.263656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-65cc4201-1327-4a33-bd4a-653c36363218 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.169920 Nov 16 16:18:17.264613 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 253/527] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:17 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:17.651671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9c8775f1-8965-4ab0-b9bc-2975f7db148d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28673 microversion: 2.1 time: 3.822451 Nov 16 16:18:17.652066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 275/528] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:13 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28673 bytes in 3825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:18.281072 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:18.281721 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:18.288367 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:18.288821 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:18.289674 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:18.290138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:18.460006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:18.470200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b59685fc-5001-4227-b8b0-2bc3c301fa9d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.192863 Nov 16 16:18:18.471916 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 254/529] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:18 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:18.664584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-36c1b2bd-254c-4cc4-877d-e6dfe0e175df tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:18.665724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-36c1b2bd-254c-4cc4-877d-e6dfe0e175df tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:18.675783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36c1b2bd-254c-4cc4-877d-e6dfe0e175df tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:18.676273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36c1b2bd-254c-4cc4-877d-e6dfe0e175df tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:18.677437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36c1b2bd-254c-4cc4-877d-e6dfe0e175df tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:18.678161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36c1b2bd-254c-4cc4-877d-e6dfe0e175df tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:18.761120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-36c1b2bd-254c-4cc4-877d-e6dfe0e175df tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 28886 microversion: 2.1 time: 0.100618 Nov 16 16:18:18.762079 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 276/530] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:18 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 28886 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:18:19.489287 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:19.490884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:19.497968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.498197 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.499289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.499700 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.656658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:19.666865 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-75fc1660-2bfd-4621-b5e5-abd6ba88b7c3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1502 microversion: 2.1 time: 0.181420 Nov 16 16:18:19.667444 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 255/531] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:19 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:19.686279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b078477-ef7f-4290-9398-425668bfa287"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:19.687775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:19.711644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.712731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.714644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.719634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.758348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] HTTP exception thrown: Cannot 'attach_volume' instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec while it is in vm_state rescued Nov 16 16:18:19.758961 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Returning 409 to user: Cannot 'attach_volume' instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec while it is in vm_state rescued {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:18:19.759807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4075b8df-72b7-417a-a8e4-731709440235 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.079332 Nov 16 16:18:19.760521 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 277/532] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:18:19 2021] POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 152 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 16 16:18:19.770038 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d050b073-5078-4f8a-9306-d5aaa533fdb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:19.771366 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d050b073-5078-4f8a-9306-d5aaa533fdb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:19.773681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fd38e8ee-3ed8-4407-afad-cc0f9f23815f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:19.774817 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fd38e8ee-3ed8-4407-afad-cc0f9f23815f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:19.778975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d050b073-5078-4f8a-9306-d5aaa533fdb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.779804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d050b073-5078-4f8a-9306-d5aaa533fdb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.780716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d050b073-5078-4f8a-9306-d5aaa533fdb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.781375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d050b073-5078-4f8a-9306-d5aaa533fdb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.782925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fd38e8ee-3ed8-4407-afad-cc0f9f23815f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.783382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fd38e8ee-3ed8-4407-afad-cc0f9f23815f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.784189 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fd38e8ee-3ed8-4407-afad-cc0f9f23815f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.784762 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fd38e8ee-3ed8-4407-afad-cc0f9f23815f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.862754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d050b073-5078-4f8a-9306-d5aaa533fdb9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action" status: 202 len: 0 microversion: 2.1 time: 0.097071 Nov 16 16:18:19.863608 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 256/533] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:19 2021] POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:18:19.871881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:19.872563 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:19.878654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.879097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:19.879852 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:19.880276 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:20.019177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:20.026847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-80c8e356-f896-4534-b20a-7d7bbf9126d3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.158711 Nov 16 16:18:20.027421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 257/534] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:19 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:18:21.049102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:21.050146 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:21.057188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:21.057634 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:21.058417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:21.058886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:21.197925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:21.205335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-130a2972-208c-4bdf-bb51-62031cdf85fa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.162694 Nov 16 16:18:21.205920 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 258/535] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:21 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:22.225594 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:22.226210 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:22.233863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:22.234313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:22.235133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:22.235568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:22.412041 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:22.421492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8dbe0b18-3342-4ad6-a6fa-1de6267e849d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.200880 Nov 16 16:18:22.429067 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 259/536] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:22 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:18:23.366513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fd38e8ee-3ed8-4407-afad-cc0f9f23815f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29796 microversion: 2.1 time: 3.593759 Nov 16 16:18:23.366513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 278/537] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:19 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29796 bytes in 3596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:18:23.444616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:23.445500 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:23.461468 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:23.461928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:23.466276 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:23.466946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:23.724393 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:23.732984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-79f7c22e-57df-41ed-a761-c3fb107c963e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.296748 Nov 16 16:18:23.734552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 260/538] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:23 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:24.378137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4ddaad8d-2ec7-48ba-aa1e-0a295c31b369 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:24.379170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4ddaad8d-2ec7-48ba-aa1e-0a295c31b369 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:24.387397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ddaad8d-2ec7-48ba-aa1e-0a295c31b369 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:24.387863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ddaad8d-2ec7-48ba-aa1e-0a295c31b369 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:24.388625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ddaad8d-2ec7-48ba-aa1e-0a295c31b369 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:24.389056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4ddaad8d-2ec7-48ba-aa1e-0a295c31b369 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:24.621200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4ddaad8d-2ec7-48ba-aa1e-0a295c31b369 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.246840 Nov 16 16:18:24.621871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 279/539] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:24 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:24.750534 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:24.751740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:24.757982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:24.758454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:24.759249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:24.759754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:24.909567 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:24.917043 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3fee84f4-0a9d-4ad9-ad25-043efcaaf71a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.170398 Nov 16 16:18:24.917610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 261/540] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:24 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:25.634130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d61a7f81-947e-4d06-857e-e2a7eedf96e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:25.635162 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d61a7f81-947e-4d06-857e-e2a7eedf96e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:25.642297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d61a7f81-947e-4d06-857e-e2a7eedf96e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:25.643683 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d61a7f81-947e-4d06-857e-e2a7eedf96e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:25.644681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d61a7f81-947e-4d06-857e-e2a7eedf96e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:25.645507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d61a7f81-947e-4d06-857e-e2a7eedf96e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:25.936375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:25.937022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:25.943813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:25.944271 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:25.945090 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:25.945543 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:26.082243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:26.090337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-df4f4376-36dc-4fcd-82d8-88a6cf3a30fc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.158113 Nov 16 16:18:26.091183 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 262/541] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:25 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:27.108024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:27.108745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:27.115327 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:27.116392 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:27.117516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:27.117948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:27.292337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:27.299922 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-613a602e-4581-4c1a-aabf-08bf65dd96d1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.195605 Nov 16 16:18:27.300855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 263/542] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:27 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:18:28.318919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:28.319483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:28.325862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:28.326311 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:28.327128 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:28.327559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:28.466368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:28.473879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-42b6f603-3d74-47bd-8c7a-b087c2a0c4b9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.159214 Nov 16 16:18:28.474488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 264/543] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:28 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:28.872883 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d61a7f81-947e-4d06-857e-e2a7eedf96e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 3.242965 Nov 16 16:18:28.877239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 280/544] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:25 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 3245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:29.491974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:29.493385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:29.501319 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:29.502351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:29.503540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:29.504190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:29.766189 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:29.780288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0b4b83e9-9512-442a-8f92-378ede249010 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.292257 Nov 16 16:18:29.784269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 265/545] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:29 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:29.886313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-eb56204c-7c3c-4f96-bb30-410c8e08a116 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:29.887359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-eb56204c-7c3c-4f96-bb30-410c8e08a116 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:29.896019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb56204c-7c3c-4f96-bb30-410c8e08a116 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:29.896802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb56204c-7c3c-4f96-bb30-410c8e08a116 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:29.898289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb56204c-7c3c-4f96-bb30-410c8e08a116 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:29.898788 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eb56204c-7c3c-4f96-bb30-410c8e08a116 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:29.966276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-eb56204c-7c3c-4f96-bb30-410c8e08a116 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.084529 Nov 16 16:18:29.971215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 281/546] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:29 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:30.800823 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:30.803596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:30.813600 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:30.814844 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:30.816543 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:30.817907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:30.980456 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-be76e32d-ac4f-48b9-8c9f-e1ffc45ed5c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:30.982714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-be76e32d-ac4f-48b9-8c9f-e1ffc45ed5c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:30.990851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be76e32d-ac4f-48b9-8c9f-e1ffc45ed5c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:30.991722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be76e32d-ac4f-48b9-8c9f-e1ffc45ed5c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:30.992681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be76e32d-ac4f-48b9-8c9f-e1ffc45ed5c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:30.993115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be76e32d-ac4f-48b9-8c9f-e1ffc45ed5c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:30.993281 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:31.002361 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a1a36565-54a5-440f-b39b-f06aedbcf41a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1510 microversion: 2.1 time: 0.207463 Nov 16 16:18:31.003904 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 266/547] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:30 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1510 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:31.089842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-be76e32d-ac4f-48b9-8c9f-e1ffc45ed5c3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.114053 Nov 16 16:18:31.091250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 282/548] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:30 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:18:32.025434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:32.027968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:32.035820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:32.036660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:32.037633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:32.038219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:32.102560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5a450e19-2b0c-4b87-8d38-dbcc9e4f26b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:32.103732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5a450e19-2b0c-4b87-8d38-dbcc9e4f26b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:32.110926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a450e19-2b0c-4b87-8d38-dbcc9e4f26b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:32.111646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a450e19-2b0c-4b87-8d38-dbcc9e4f26b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:32.112639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a450e19-2b0c-4b87-8d38-dbcc9e4f26b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:32.113255 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a450e19-2b0c-4b87-8d38-dbcc9e4f26b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:32.179312 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:32.187308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-41caa007-47ea-494f-b662-b142e1522ade tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1516 microversion: 2.1 time: 0.169989 Nov 16 16:18:32.187900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 267/549] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:32 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:32.215011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5a450e19-2b0c-4b87-8d38-dbcc9e4f26b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.116608 Nov 16 16:18:32.215862 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 283/550] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:32 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:18:33.229635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-60ebc3c3-be18-46b6-99a3-b1503cb78e94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:33.230649 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-60ebc3c3-be18-46b6-99a3-b1503cb78e94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:33.237394 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60ebc3c3-be18-46b6-99a3-b1503cb78e94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:33.237851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60ebc3c3-be18-46b6-99a3-b1503cb78e94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:33.238650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60ebc3c3-be18-46b6-99a3-b1503cb78e94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:33.239083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60ebc3c3-be18-46b6-99a3-b1503cb78e94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:33.332644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-60ebc3c3-be18-46b6-99a3-b1503cb78e94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.106643 Nov 16 16:18:33.333261 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 268/551] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:33 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:34.345604 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a0061799-7b8a-4607-bd1b-a8e9c8f660a8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:34.346746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a0061799-7b8a-4607-bd1b-a8e9c8f660a8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:34.354499 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0061799-7b8a-4607-bd1b-a8e9c8f660a8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:34.354990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0061799-7b8a-4607-bd1b-a8e9c8f660a8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:34.355842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0061799-7b8a-4607-bd1b-a8e9c8f660a8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:34.356274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0061799-7b8a-4607-bd1b-a8e9c8f660a8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:34.575779 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a0061799-7b8a-4607-bd1b-a8e9c8f660a8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.234093 Nov 16 16:18:34.576799 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 284/552] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:34 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:35.588250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-efcadfba-5ea0-4ae3-9a80-eb45e97c2890 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:35.589271 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-efcadfba-5ea0-4ae3-9a80-eb45e97c2890 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:35.597184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-efcadfba-5ea0-4ae3-9a80-eb45e97c2890 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:35.597848 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-efcadfba-5ea0-4ae3-9a80-eb45e97c2890 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:35.598415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-efcadfba-5ea0-4ae3-9a80-eb45e97c2890 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:35.598980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-efcadfba-5ea0-4ae3-9a80-eb45e97c2890 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:35.701620 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-efcadfba-5ea0-4ae3-9a80-eb45e97c2890 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.117451 Nov 16 16:18:35.702273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 269/553] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:35 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:36.714996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b4bf0ec6-2bab-4390-b620-6b8987aa38bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:36.716150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b4bf0ec6-2bab-4390-b620-6b8987aa38bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:36.723992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4bf0ec6-2bab-4390-b620-6b8987aa38bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:36.724606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4bf0ec6-2bab-4390-b620-6b8987aa38bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:36.725824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4bf0ec6-2bab-4390-b620-6b8987aa38bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:36.726309 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4bf0ec6-2bab-4390-b620-6b8987aa38bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:36.827586 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b4bf0ec6-2bab-4390-b620-6b8987aa38bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.116106 Nov 16 16:18:36.828668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 285/554] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:36 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:37.748155 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:37.748858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:37.755957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:37.756401 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:37.757179 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:37.757615 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:37.839228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cda34b1c-574a-472d-b992-366425c422b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:37.840423 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cda34b1c-574a-472d-b992-366425c422b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:37.853806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cda34b1c-574a-472d-b992-366425c422b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:37.854249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cda34b1c-574a-472d-b992-366425c422b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:37.855187 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cda34b1c-574a-472d-b992-366425c422b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:37.855625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cda34b1c-574a-472d-b992-366425c422b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:37.903328 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:18:37.911378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1f8deba9-ef82-4640-8802-f427529f3f0b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1516 microversion: 2.1 time: 0.167584 Nov 16 16:18:37.911945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 270/555] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:18:37 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1516 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:18:37.928258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e31524a5-3774-474a-bf5e-b070754147bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fc3d4ee-108d-47d5-8aa1-6863dd3efc99"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:37.929247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e31524a5-3774-474a-bf5e-b070754147bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:37.930894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cda34b1c-574a-472d-b992-366425c422b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.095868 Nov 16 16:18:37.931588 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 286/556] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:37 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:37.935447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e31524a5-3774-474a-bf5e-b070754147bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:37.935889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e31524a5-3774-474a-bf5e-b070754147bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:37.936671 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e31524a5-3774-474a-bf5e-b070754147bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:37.937139 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e31524a5-3774-474a-bf5e-b070754147bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:38.201012 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e31524a5-3774-474a-bf5e-b070754147bb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276211 Nov 16 16:18:38.201686 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 271/557] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:18:37 2021] POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:18:38.943654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-193844b8-ce63-4c48-8c92-9a4732787486 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:38.944669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-193844b8-ce63-4c48-8c92-9a4732787486 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:38.951845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-193844b8-ce63-4c48-8c92-9a4732787486 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:38.952749 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-193844b8-ce63-4c48-8c92-9a4732787486 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:38.953741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-193844b8-ce63-4c48-8c92-9a4732787486 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:38.954372 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-193844b8-ce63-4c48-8c92-9a4732787486 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:43.104713 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-193844b8-ce63-4c48-8c92-9a4732787486 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 4.164364 Nov 16 16:18:43.105979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 287/558] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:38 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 4167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:44.123625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bb13af18-78d0-4b66-b9ae-33f01220a2ef tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:44.124943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bb13af18-78d0-4b66-b9ae-33f01220a2ef tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:44.132247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb13af18-78d0-4b66-b9ae-33f01220a2ef tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.133437 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb13af18-78d0-4b66-b9ae-33f01220a2ef tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:44.133800 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb13af18-78d0-4b66-b9ae-33f01220a2ef tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.134282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb13af18-78d0-4b66-b9ae-33f01220a2ef tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:44.219590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bb13af18-78d0-4b66-b9ae-33f01220a2ef tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.103551 Nov 16 16:18:44.220341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 272/559] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:44 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:44.633257 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:44.634070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:44.642130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.642821 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:44.643638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.644216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:44.688296 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad2ebb6c-5026-4e5c-9ace-280c90f4a5f5"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:44.689458 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:44.696504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.697059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:44.697739 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.698358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:44.732193 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lazy-loading 'services' on Instance uuid 5b5a028c-3cac-418b-bf82-6171c049f94e {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:18:44.778842 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] HTTP exception thrown: Invalid volume: volume ad2ebb6c-5026-4e5c-9ace-280c90f4a5f5 is already attached to instances: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 Nov 16 16:18:44.779423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Returning 400 to user: Invalid volume: volume ad2ebb6c-5026-4e5c-9ace-280c90f4a5f5 is already attached to instances: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:18:44.780290 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1838ec39-9889-49f5-8514-e5756e124408 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096243 Nov 16 16:18:44.780822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 273/560] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:18:44 2021] POST /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 16 16:18:44.833406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-71172452-8b5b-461c-841e-ebe53dd96c25 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e/os-volume_attachments/50f6fa75-2646-4f86-9220-78a1e6df4c44" status: 202 len: 0 microversion: 2.1 time: 0.204426 Nov 16 16:18:44.834013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 288/561] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:18:44 2021] DELETE /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e/os-volume_attachments/50f6fa75-2646-4f86-9220-78a1e6df4c44 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:18:44.875577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:44.876298 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:44.883476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.884116 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:44.884896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:44.885321 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:45.009430 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lazy-loading 'services' on Instance uuid 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:18:45.130352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d4f7fc21-7e9e-4eb5-ac4e-323fed665469 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments/ad2ebb6c-5026-4e5c-9ace-280c90f4a5f5" status: 202 len: 0 microversion: 2.1 time: 0.258182 Nov 16 16:18:45.131177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 274/562] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:18:44 2021] DELETE /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments/ad2ebb6c-5026-4e5c-9ace-280c90f4a5f5 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:18:45.142368 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d6ed065d-220a-48d2-95eb-f451457eb995 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:45.143398 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d6ed065d-220a-48d2-95eb-f451457eb995 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:45.150739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6ed065d-220a-48d2-95eb-f451457eb995 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:45.151244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6ed065d-220a-48d2-95eb-f451457eb995 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:45.152355 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6ed065d-220a-48d2-95eb-f451457eb995 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:45.153847 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6ed065d-220a-48d2-95eb-f451457eb995 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:45.188247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d6ed065d-220a-48d2-95eb-f451457eb995 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050635 Nov 16 16:18:45.188828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 289/563] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:45 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:45.235081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-29c6b4db-143f-427d-91e1-68c0fde3b9dc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:45.236180 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-29c6b4db-143f-427d-91e1-68c0fde3b9dc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:45.245231 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29c6b4db-143f-427d-91e1-68c0fde3b9dc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:45.245988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29c6b4db-143f-427d-91e1-68c0fde3b9dc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:45.247378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29c6b4db-143f-427d-91e1-68c0fde3b9dc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:45.248121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29c6b4db-143f-427d-91e1-68c0fde3b9dc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:45.328232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-29c6b4db-143f-427d-91e1-68c0fde3b9dc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.100223 Nov 16 16:18:45.328878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 275/564] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:45 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:46.200417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2e568bd1-8164-465b-8945-eb4ef78bac1f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:46.201311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2e568bd1-8164-465b-8945-eb4ef78bac1f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:46.213820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e568bd1-8164-465b-8945-eb4ef78bac1f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:46.214413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e568bd1-8164-465b-8945-eb4ef78bac1f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:46.215509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e568bd1-8164-465b-8945-eb4ef78bac1f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:46.216117 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e568bd1-8164-465b-8945-eb4ef78bac1f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:46.249177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2e568bd1-8164-465b-8945-eb4ef78bac1f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052722 Nov 16 16:18:46.250130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 290/565] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:46 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:46.342926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3b5c2bc1-695e-4463-9328-755804e89f44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:46.344202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3b5c2bc1-695e-4463-9328-755804e89f44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:46.352673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3b5c2bc1-695e-4463-9328-755804e89f44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:46.353333 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3b5c2bc1-695e-4463-9328-755804e89f44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:46.354586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3b5c2bc1-695e-4463-9328-755804e89f44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:46.355079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3b5c2bc1-695e-4463-9328-755804e89f44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:47.261457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4d95b3cf-ab71-4e76-b94f-ef9d3a7adf34 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:47.263066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4d95b3cf-ab71-4e76-b94f-ef9d3a7adf34 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:47.269573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d95b3cf-ab71-4e76-b94f-ef9d3a7adf34 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:47.270443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d95b3cf-ab71-4e76-b94f-ef9d3a7adf34 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:47.271421 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d95b3cf-ab71-4e76-b94f-ef9d3a7adf34 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:47.271986 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d95b3cf-ab71-4e76-b94f-ef9d3a7adf34 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:47.304361 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4d95b3cf-ab71-4e76-b94f-ef9d3a7adf34 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 Nov 16 16:18:47.304923 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 291/566] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:47 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:48.320658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fa4063be-a1da-4b18-b93a-a9c7a8c8c9b3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:48.322136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fa4063be-a1da-4b18-b93a-a9c7a8c8c9b3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:48.330690 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa4063be-a1da-4b18-b93a-a9c7a8c8c9b3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:48.331139 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa4063be-a1da-4b18-b93a-a9c7a8c8c9b3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:48.331900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa4063be-a1da-4b18-b93a-a9c7a8c8c9b3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:48.332324 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fa4063be-a1da-4b18-b93a-a9c7a8c8c9b3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:48.362870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fa4063be-a1da-4b18-b93a-a9c7a8c8c9b3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048611 Nov 16 16:18:48.363709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 292/567] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:48 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:48.465389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3b5c2bc1-695e-4463-9328-755804e89f44 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 2.128072 Nov 16 16:18:48.466025 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 276/568] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:46 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:49.374962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ffcba74d-f031-4c57-b4c9-0d261cc1f860 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:49.375779 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ffcba74d-f031-4c57-b4c9-0d261cc1f860 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:49.382473 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffcba74d-f031-4c57-b4c9-0d261cc1f860 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:49.382990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffcba74d-f031-4c57-b4c9-0d261cc1f860 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:49.383681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffcba74d-f031-4c57-b4c9-0d261cc1f860 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:49.384112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffcba74d-f031-4c57-b4c9-0d261cc1f860 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:49.416281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ffcba74d-f031-4c57-b4c9-0d261cc1f860 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Nov 16 16:18:49.416825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 293/569] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:49 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:49.480150 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f9bd8e07-6c64-4cc6-aca7-5383ddbafa19 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:49.481385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f9bd8e07-6c64-4cc6-aca7-5383ddbafa19 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:49.491124 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9bd8e07-6c64-4cc6-aca7-5383ddbafa19 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:49.491673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9bd8e07-6c64-4cc6-aca7-5383ddbafa19 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:49.492629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9bd8e07-6c64-4cc6-aca7-5383ddbafa19 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:49.493159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9bd8e07-6c64-4cc6-aca7-5383ddbafa19 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:50.189199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f9bd8e07-6c64-4cc6-aca7-5383ddbafa19 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.713887 Nov 16 16:18:50.189840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 277/570] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:49 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:50.428367 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-520781c2-b651-40e5-b418-46c4a5a6d00d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:50.429266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-520781c2-b651-40e5-b418-46c4a5a6d00d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:50.436818 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-520781c2-b651-40e5-b418-46c4a5a6d00d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:50.437288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-520781c2-b651-40e5-b418-46c4a5a6d00d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:50.438142 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-520781c2-b651-40e5-b418-46c4a5a6d00d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:50.438608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-520781c2-b651-40e5-b418-46c4a5a6d00d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:50.468938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-520781c2-b651-40e5-b418-46c4a5a6d00d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Nov 16 16:18:50.469512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 294/571] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:50 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:51.201819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-44d40801-91a3-4651-aaf1-53de1b7d03d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:51.202846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-44d40801-91a3-4651-aaf1-53de1b7d03d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:51.210658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-44d40801-91a3-4651-aaf1-53de1b7d03d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:51.211228 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-44d40801-91a3-4651-aaf1-53de1b7d03d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:51.211893 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-44d40801-91a3-4651-aaf1-53de1b7d03d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:51.212333 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-44d40801-91a3-4651-aaf1-53de1b7d03d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:51.305603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-44d40801-91a3-4651-aaf1-53de1b7d03d6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.107785 Nov 16 16:18:51.306231 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 278/572] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:51 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:51.427450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:18:51.427704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: Tue Nov 16 16:18:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:18:51.481143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2306c6f6-46fe-4901-8ab0-b2c3f2aa06b9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:51.482090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2306c6f6-46fe-4901-8ab0-b2c3f2aa06b9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:51.489194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2306c6f6-46fe-4901-8ab0-b2c3f2aa06b9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:51.489645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2306c6f6-46fe-4901-8ab0-b2c3f2aa06b9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:51.490465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2306c6f6-46fe-4901-8ab0-b2c3f2aa06b9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:51.490898 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2306c6f6-46fe-4901-8ab0-b2c3f2aa06b9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:51.521278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2306c6f6-46fe-4901-8ab0-b2c3f2aa06b9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Nov 16 16:18:51.521824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 295/573] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:51 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:52.318006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-df939244-f172-43fe-86ac-0279afd893b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:52.319138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-df939244-f172-43fe-86ac-0279afd893b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:52.326923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df939244-f172-43fe-86ac-0279afd893b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:52.327378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df939244-f172-43fe-86ac-0279afd893b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:52.328168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df939244-f172-43fe-86ac-0279afd893b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:52.328630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-df939244-f172-43fe-86ac-0279afd893b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:52.538083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-10f3c926-e0c1-4e67-b4cf-536d808e125c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:52.539598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-10f3c926-e0c1-4e67-b4cf-536d808e125c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:52.549075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-10f3c926-e0c1-4e67-b4cf-536d808e125c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:52.549520 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-10f3c926-e0c1-4e67-b4cf-536d808e125c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:52.550283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-10f3c926-e0c1-4e67-b4cf-536d808e125c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:52.550743 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-10f3c926-e0c1-4e67-b4cf-536d808e125c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:52.583672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-10f3c926-e0c1-4e67-b4cf-536d808e125c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053011 Nov 16 16:18:52.584248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 296/574] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:52 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:53.599731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5463a91d-02f9-4ac8-af06-ed9b2df354e4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:53.601048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5463a91d-02f9-4ac8-af06-ed9b2df354e4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:53.611576 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5463a91d-02f9-4ac8-af06-ed9b2df354e4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:53.612026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5463a91d-02f9-4ac8-af06-ed9b2df354e4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:53.612797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5463a91d-02f9-4ac8-af06-ed9b2df354e4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:53.613230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5463a91d-02f9-4ac8-af06-ed9b2df354e4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:53.644203 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5463a91d-02f9-4ac8-af06-ed9b2df354e4 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051091 Nov 16 16:18:53.644763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 297/575] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:53 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:54.656537 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-96d6f31c-0081-4cdc-a4a1-0e0a0fa38ecc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:54.657359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-96d6f31c-0081-4cdc-a4a1-0e0a0fa38ecc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:54.664417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96d6f31c-0081-4cdc-a4a1-0e0a0fa38ecc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:54.664908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96d6f31c-0081-4cdc-a4a1-0e0a0fa38ecc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:54.665722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96d6f31c-0081-4cdc-a4a1-0e0a0fa38ecc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:54.666194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-96d6f31c-0081-4cdc-a4a1-0e0a0fa38ecc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:54.702266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-96d6f31c-0081-4cdc-a4a1-0e0a0fa38ecc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049537 Nov 16 16:18:54.702858 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 298/576] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:54 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:55.526123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-df939244-f172-43fe-86ac-0279afd893b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 3.212210 Nov 16 16:18:55.527471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 279/577] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:52 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 3215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:55.715580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-47c87eec-3e47-4808-adbe-e06263a2c223 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:55.716443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-47c87eec-3e47-4808-adbe-e06263a2c223 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:55.723703 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47c87eec-3e47-4808-adbe-e06263a2c223 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:55.724179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47c87eec-3e47-4808-adbe-e06263a2c223 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:55.725130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47c87eec-3e47-4808-adbe-e06263a2c223 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:55.725564 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47c87eec-3e47-4808-adbe-e06263a2c223 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:55.756813 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-47c87eec-3e47-4808-adbe-e06263a2c223 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045740 Nov 16 16:18:55.757393 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 299/578] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:55 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:56.539255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-302dbbf8-96e9-4b5a-841a-98d73d86b74e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:56.543071 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-302dbbf8-96e9-4b5a-841a-98d73d86b74e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:56.550221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-302dbbf8-96e9-4b5a-841a-98d73d86b74e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:56.550809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-302dbbf8-96e9-4b5a-841a-98d73d86b74e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:56.551589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-302dbbf8-96e9-4b5a-841a-98d73d86b74e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:56.552016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-302dbbf8-96e9-4b5a-841a-98d73d86b74e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:56.768934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-da531fbf-4a95-4522-b2ed-2fa68488e869 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:56.770172 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-da531fbf-4a95-4522-b2ed-2fa68488e869 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:56.777122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-da531fbf-4a95-4522-b2ed-2fa68488e869 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:56.777563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-da531fbf-4a95-4522-b2ed-2fa68488e869 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:56.778342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-da531fbf-4a95-4522-b2ed-2fa68488e869 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:56.778814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-da531fbf-4a95-4522-b2ed-2fa68488e869 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:56.809351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-da531fbf-4a95-4522-b2ed-2fa68488e869 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044415 Nov 16 16:18:56.809890 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 300/579] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:56 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:57.824699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ae748087-e25d-4f9f-afe3-f13334625f91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:57.826166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ae748087-e25d-4f9f-afe3-f13334625f91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:57.835049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae748087-e25d-4f9f-afe3-f13334625f91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:57.835495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae748087-e25d-4f9f-afe3-f13334625f91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:57.836292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae748087-e25d-4f9f-afe3-f13334625f91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:57.836718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae748087-e25d-4f9f-afe3-f13334625f91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:57.868441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ae748087-e25d-4f9f-afe3-f13334625f91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050095 Nov 16 16:18:57.869012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 301/580] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:57 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:57.941798 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-302dbbf8-96e9-4b5a-841a-98d73d86b74e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 1.405908 Nov 16 16:18:57.943000 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 280/581] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:56 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:58.880678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-79eda9fd-c740-4e9e-b799-5e09891c6c79 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:58.881496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-79eda9fd-c740-4e9e-b799-5e09891c6c79 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:58.891576 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79eda9fd-c740-4e9e-b799-5e09891c6c79 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:58.892371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79eda9fd-c740-4e9e-b799-5e09891c6c79 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:58.894332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79eda9fd-c740-4e9e-b799-5e09891c6c79 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:58.895607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-79eda9fd-c740-4e9e-b799-5e09891c6c79 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:58.935524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-79eda9fd-c740-4e9e-b799-5e09891c6c79 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058851 Nov 16 16:18:58.936075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 302/582] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:58 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:18:58.958610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4b16fb23-bcd7-41df-950f-e5e7e3548ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:18:58.959643 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4b16fb23-bcd7-41df-950f-e5e7e3548ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:58.968071 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b16fb23-bcd7-41df-950f-e5e7e3548ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:58.968505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b16fb23-bcd7-41df-950f-e5e7e3548ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:58.969283 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b16fb23-bcd7-41df-950f-e5e7e3548ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:58.969712 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b16fb23-bcd7-41df-950f-e5e7e3548ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:59.074858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4b16fb23-bcd7-41df-950f-e5e7e3548ef5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.120000 Nov 16 16:18:59.075894 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 281/583] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:18:58 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:18:59.947532 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0915ce4d-a2f2-46b9-ae0b-6d449f22a438 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:18:59.948322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0915ce4d-a2f2-46b9-ae0b-6d449f22a438 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:18:59.954674 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0915ce4d-a2f2-46b9-ae0b-6d449f22a438 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:59.955106 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0915ce4d-a2f2-46b9-ae0b-6d449f22a438 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:59.955861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0915ce4d-a2f2-46b9-ae0b-6d449f22a438 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:18:59.956279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0915ce4d-a2f2-46b9-ae0b-6d449f22a438 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:18:59.986368 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0915ce4d-a2f2-46b9-ae0b-6d449f22a438 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 Nov 16 16:18:59.986957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 303/584] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:18:59 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:00.093807 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7ce9771a-382d-4135-b583-e69a20a0297b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:00.095549 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7ce9771a-382d-4135-b583-e69a20a0297b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:00.106464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ce9771a-382d-4135-b583-e69a20a0297b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:00.107244 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ce9771a-382d-4135-b583-e69a20a0297b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:00.108461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ce9771a-382d-4135-b583-e69a20a0297b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:00.109155 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7ce9771a-382d-4135-b583-e69a20a0297b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:00.204927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7ce9771a-382d-4135-b583-e69a20a0297b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.117596 Nov 16 16:19:00.205484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 282/585] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:00 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:01.000038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6d99c73a-c127-4d0d-ae92-1e2de5492e1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:01.000883 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6d99c73a-c127-4d0d-ae92-1e2de5492e1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:01.007462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d99c73a-c127-4d0d-ae92-1e2de5492e1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:01.007904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d99c73a-c127-4d0d-ae92-1e2de5492e1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:01.008838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d99c73a-c127-4d0d-ae92-1e2de5492e1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:01.009274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d99c73a-c127-4d0d-ae92-1e2de5492e1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:01.043190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6d99c73a-c127-4d0d-ae92-1e2de5492e1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047628 Nov 16 16:19:01.043737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 304/586] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:00 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:01.221963 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e0ef4fac-7a62-4b69-b95b-81740fed8ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:01.223662 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e0ef4fac-7a62-4b69-b95b-81740fed8ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:01.230993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0ef4fac-7a62-4b69-b95b-81740fed8ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:01.231428 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0ef4fac-7a62-4b69-b95b-81740fed8ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:01.232236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0ef4fac-7a62-4b69-b95b-81740fed8ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:01.232663 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e0ef4fac-7a62-4b69-b95b-81740fed8ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:02.058646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-48723ebd-7754-4e09-a749-beca0ed60528 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:02.059955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-48723ebd-7754-4e09-a749-beca0ed60528 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:02.069450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48723ebd-7754-4e09-a749-beca0ed60528 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:02.069892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48723ebd-7754-4e09-a749-beca0ed60528 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:02.070712 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48723ebd-7754-4e09-a749-beca0ed60528 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:02.071125 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48723ebd-7754-4e09-a749-beca0ed60528 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:02.100506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-48723ebd-7754-4e09-a749-beca0ed60528 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047610 Nov 16 16:19:02.101048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 305/587] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:02 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:19:03.117907 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d1c9b188-0067-4870-a552-3157ab56bf42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:03.119491 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d1c9b188-0067-4870-a552-3157ab56bf42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:03.130029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1c9b188-0067-4870-a552-3157ab56bf42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:03.130733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1c9b188-0067-4870-a552-3157ab56bf42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:03.131759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1c9b188-0067-4870-a552-3157ab56bf42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:03.132376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1c9b188-0067-4870-a552-3157ab56bf42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:03.166488 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d1c9b188-0067-4870-a552-3157ab56bf42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055039 Nov 16 16:19:03.167032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 306/588] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:03 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:04.178951 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4068f689-2fbe-46a8-8d4b-e74cee50cd05 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:04.180044 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4068f689-2fbe-46a8-8d4b-e74cee50cd05 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:04.188489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4068f689-2fbe-46a8-8d4b-e74cee50cd05 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:04.189287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4068f689-2fbe-46a8-8d4b-e74cee50cd05 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:04.190292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4068f689-2fbe-46a8-8d4b-e74cee50cd05 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:04.191249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4068f689-2fbe-46a8-8d4b-e74cee50cd05 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:04.236727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4068f689-2fbe-46a8-8d4b-e74cee50cd05 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061558 Nov 16 16:19:04.237673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 307/589] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:04 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:05.254265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-22255e1b-4a46-4154-99a4-ca1684ac1205 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:05.255769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-22255e1b-4a46-4154-99a4-ca1684ac1205 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:05.266667 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22255e1b-4a46-4154-99a4-ca1684ac1205 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:05.267386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22255e1b-4a46-4154-99a4-ca1684ac1205 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:05.268669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22255e1b-4a46-4154-99a4-ca1684ac1205 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:05.269391 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22255e1b-4a46-4154-99a4-ca1684ac1205 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:05.305101 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-22255e1b-4a46-4154-99a4-ca1684ac1205 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057034 Nov 16 16:19:05.305664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 308/590] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:05 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:05.509760 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e0ef4fac-7a62-4b69-b95b-81740fed8ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 4.294180 Nov 16 16:19:05.510497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 283/591] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:01 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 4297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:06.321056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c937ee9f-e57f-4bec-be82-034fecf7b06e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:06.321969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c937ee9f-e57f-4bec-be82-034fecf7b06e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:06.330186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c937ee9f-e57f-4bec-be82-034fecf7b06e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:06.330921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c937ee9f-e57f-4bec-be82-034fecf7b06e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:06.331878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c937ee9f-e57f-4bec-be82-034fecf7b06e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:06.332397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c937ee9f-e57f-4bec-be82-034fecf7b06e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:06.368083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c937ee9f-e57f-4bec-be82-034fecf7b06e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053332 Nov 16 16:19:06.368915 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 309/592] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:06 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:06.526526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a1c9e31c-649f-4f47-a9e4-6a1d5942c488 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:06.529094 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a1c9e31c-649f-4f47-a9e4-6a1d5942c488 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:06.539961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1c9e31c-649f-4f47-a9e4-6a1d5942c488 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:06.540390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1c9e31c-649f-4f47-a9e4-6a1d5942c488 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:06.541170 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1c9e31c-649f-4f47-a9e4-6a1d5942c488 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:06.541597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a1c9e31c-649f-4f47-a9e4-6a1d5942c488 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:07.387522 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-360d6f4c-10a6-4ab8-aa4f-ddef56f44218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:07.389574 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-360d6f4c-10a6-4ab8-aa4f-ddef56f44218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:07.400249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-360d6f4c-10a6-4ab8-aa4f-ddef56f44218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:07.400684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-360d6f4c-10a6-4ab8-aa4f-ddef56f44218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:07.401696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-360d6f4c-10a6-4ab8-aa4f-ddef56f44218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:07.402148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-360d6f4c-10a6-4ab8-aa4f-ddef56f44218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:07.432598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-360d6f4c-10a6-4ab8-aa4f-ddef56f44218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052773 Nov 16 16:19:07.433151 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 310/593] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:07 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:07.667475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a1c9e31c-649f-4f47-a9e4-6a1d5942c488 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 1.147866 Nov 16 16:19:07.668085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 284/594] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:06 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:08.444034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3dd65b34-d56a-4df1-bbbc-a4548236ea83 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:08.444952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3dd65b34-d56a-4df1-bbbc-a4548236ea83 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:08.453891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3dd65b34-d56a-4df1-bbbc-a4548236ea83 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:08.454332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3dd65b34-d56a-4df1-bbbc-a4548236ea83 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:08.455127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3dd65b34-d56a-4df1-bbbc-a4548236ea83 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:08.455559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3dd65b34-d56a-4df1-bbbc-a4548236ea83 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:08.486626 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3dd65b34-d56a-4df1-bbbc-a4548236ea83 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046372 Nov 16 16:19:08.487181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 311/595] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:08 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:08.685021 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7f20e6ce-9d0b-4da4-8fb4-f1a909e2453c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:08.686584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7f20e6ce-9d0b-4da4-8fb4-f1a909e2453c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:08.697923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f20e6ce-9d0b-4da4-8fb4-f1a909e2453c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:08.698368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f20e6ce-9d0b-4da4-8fb4-f1a909e2453c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:08.699179 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f20e6ce-9d0b-4da4-8fb4-f1a909e2453c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:08.699610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7f20e6ce-9d0b-4da4-8fb4-f1a909e2453c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:08.781232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7f20e6ce-9d0b-4da4-8fb4-f1a909e2453c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.104487 Nov 16 16:19:08.782178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 285/596] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:08 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:09.503454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6153cfd9-1954-4a8d-a915-a699a6b97988 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:09.504769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6153cfd9-1954-4a8d-a915-a699a6b97988 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:09.512674 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6153cfd9-1954-4a8d-a915-a699a6b97988 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:09.513106 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6153cfd9-1954-4a8d-a915-a699a6b97988 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:09.513864 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6153cfd9-1954-4a8d-a915-a699a6b97988 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:09.514328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6153cfd9-1954-4a8d-a915-a699a6b97988 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:09.543743 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6153cfd9-1954-4a8d-a915-a699a6b97988 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046900 Nov 16 16:19:09.544293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 312/597] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:09 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:09.796119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cbf871ec-bc80-49c9-861f-913fa4a0446e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:09.797140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cbf871ec-bc80-49c9-861f-913fa4a0446e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:09.804982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbf871ec-bc80-49c9-861f-913fa4a0446e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:09.805464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbf871ec-bc80-49c9-861f-913fa4a0446e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:09.806270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbf871ec-bc80-49c9-861f-913fa4a0446e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:09.806740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cbf871ec-bc80-49c9-861f-913fa4a0446e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:10.557652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-edf31814-428c-4d21-987e-fb7c81f6363e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:10.558579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-edf31814-428c-4d21-987e-fb7c81f6363e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:10.565402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edf31814-428c-4d21-987e-fb7c81f6363e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:10.565837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edf31814-428c-4d21-987e-fb7c81f6363e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:10.566625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edf31814-428c-4d21-987e-fb7c81f6363e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:10.567046 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edf31814-428c-4d21-987e-fb7c81f6363e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:10.596649 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-edf31814-428c-4d21-987e-fb7c81f6363e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Nov 16 16:19:10.597187 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 313/598] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:10 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:11.611881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a515f1d1-f141-48e0-9a38-de572bf24172 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:11.612865 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a515f1d1-f141-48e0-9a38-de572bf24172 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:11.621916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a515f1d1-f141-48e0-9a38-de572bf24172 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:11.622478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a515f1d1-f141-48e0-9a38-de572bf24172 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:11.623618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a515f1d1-f141-48e0-9a38-de572bf24172 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:11.624205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a515f1d1-f141-48e0-9a38-de572bf24172 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:11.656311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a515f1d1-f141-48e0-9a38-de572bf24172 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050719 Nov 16 16:19:11.656843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 314/599] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:11 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:12.671913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f97138b7-e81e-48ce-a15e-34fd5ccbfe39 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:12.673148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f97138b7-e81e-48ce-a15e-34fd5ccbfe39 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:12.683097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f97138b7-e81e-48ce-a15e-34fd5ccbfe39 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:12.683742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f97138b7-e81e-48ce-a15e-34fd5ccbfe39 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:12.684852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f97138b7-e81e-48ce-a15e-34fd5ccbfe39 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:12.685288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f97138b7-e81e-48ce-a15e-34fd5ccbfe39 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:12.725418 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f97138b7-e81e-48ce-a15e-34fd5ccbfe39 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059927 Nov 16 16:19:12.726086 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 315/600] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:12 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:13.740623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a53c5ba5-a3ef-46b9-aca7-8e5c5d433eb0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:13.741733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a53c5ba5-a3ef-46b9-aca7-8e5c5d433eb0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:13.749973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a53c5ba5-a3ef-46b9-aca7-8e5c5d433eb0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:13.750573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a53c5ba5-a3ef-46b9-aca7-8e5c5d433eb0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:13.751550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a53c5ba5-a3ef-46b9-aca7-8e5c5d433eb0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:13.752081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a53c5ba5-a3ef-46b9-aca7-8e5c5d433eb0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:13.789250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a53c5ba5-a3ef-46b9-aca7-8e5c5d433eb0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053495 Nov 16 16:19:13.789845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 316/601] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:13 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:19:13.990032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cbf871ec-bc80-49c9-861f-913fa4a0446e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 4.197728 Nov 16 16:19:13.991186 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 286/602] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:09 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 4200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:14.468537 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:14.469510 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:14.476056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:14.476507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:14.477365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:14.477794 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:14.501720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lazy-loading 'flavor' on Instance uuid ca96c22d-d0ae-48e0-9f0f-fa02d0324fec {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:19:14.631492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2d079ca4-554c-4961-9fee-85084347d6ef tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action" status: 200 len: 32 microversion: 2.1 time: 0.166766 Nov 16 16:19:14.632072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 317/603] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:14 2021] POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:19:14.645406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:14.646518 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:14.657337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:14.658332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:14.659239 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:14.659888 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:14.801952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-15171604-c461-4455-8670-eef769594366 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:14.803012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-15171604-c461-4455-8670-eef769594366 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:14.807804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:14.810053 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15171604-c461-4455-8670-eef769594366 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:14.810905 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15171604-c461-4455-8670-eef769594366 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:14.811931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15171604-c461-4455-8670-eef769594366 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:14.812355 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15171604-c461-4455-8670-eef769594366 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:14.816156 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-75d60f39-3dd2-44ab-a744-f3369afa5ef4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.176331 Nov 16 16:19:14.817010 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 287/604] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:14 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:14.849032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-15171604-c461-4455-8670-eef769594366 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051950 Nov 16 16:19:14.852326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 318/605] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:14 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:15.004213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2d9a3a29-609b-4033-8628-12d2a821232b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:15.005278 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2d9a3a29-609b-4033-8628-12d2a821232b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:15.012088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d9a3a29-609b-4033-8628-12d2a821232b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:15.012547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d9a3a29-609b-4033-8628-12d2a821232b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:15.013337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d9a3a29-609b-4033-8628-12d2a821232b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:15.013773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2d9a3a29-609b-4033-8628-12d2a821232b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:15.086650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2d9a3a29-609b-4033-8628-12d2a821232b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.085601 Nov 16 16:19:15.087504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 288/606] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:14 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:15.837887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:15.838508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:15.845105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:15.845712 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:15.846506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:15.846965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:15.861430 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-82ba5bb8-8e75-4c57-81b5-10dc6df97023 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:15.862619 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-82ba5bb8-8e75-4c57-81b5-10dc6df97023 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:15.870024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82ba5bb8-8e75-4c57-81b5-10dc6df97023 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:15.870501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82ba5bb8-8e75-4c57-81b5-10dc6df97023 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:15.871298 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82ba5bb8-8e75-4c57-81b5-10dc6df97023 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:15.871740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-82ba5bb8-8e75-4c57-81b5-10dc6df97023 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:15.903383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-82ba5bb8-8e75-4c57-81b5-10dc6df97023 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046071 Nov 16 16:19:15.903947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 289/607] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:15 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:15.983407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:15.995528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7e2c9b4a-fceb-475a-8550-6f75c68df669 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.162938 Nov 16 16:19:15.996298 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 319/608] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:15 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:16.099251 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b51055ba-30d5-431d-8190-3e299106e211 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:16.100070 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b51055ba-30d5-431d-8190-3e299106e211 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:16.106853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b51055ba-30d5-431d-8190-3e299106e211 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.107303 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b51055ba-30d5-431d-8190-3e299106e211 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.108077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b51055ba-30d5-431d-8190-3e299106e211 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.108502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b51055ba-30d5-431d-8190-3e299106e211 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.179921 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b51055ba-30d5-431d-8190-3e299106e211 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.084480 Nov 16 16:19:16.180537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 290/609] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:16 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:16.722222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:16.722774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:16.729231 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.729766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.730594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.731122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.765278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:19:16.843867 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6d38c7d0-9c03-4b9c-9758-c4853c1c02cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 204 len: 0 microversion: 2.1 time: 0.125075 Nov 16 16:19:16.844585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 320/610] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:19:16 2021] DELETE /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:19:16.853779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:16.854702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:16.862025 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.862512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.863317 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.863751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.915852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-049c9c26-9d3c-4636-8828-ca75f3b99cf6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:16.917975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-049c9c26-9d3c-4636-8828-ca75f3b99cf6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:16.925455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-049c9c26-9d3c-4636-8828-ca75f3b99cf6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.925989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-049c9c26-9d3c-4636-8828-ca75f3b99cf6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.926841 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-049c9c26-9d3c-4636-8828-ca75f3b99cf6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:16.927270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-049c9c26-9d3c-4636-8828-ca75f3b99cf6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:16.960240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-049c9c26-9d3c-4636-8828-ca75f3b99cf6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Nov 16 16:19:16.960819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 321/611] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:16 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:17.018137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:17.018793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:17.024946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:17.025612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:17.026241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:17.027129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:17.027558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:17.032979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1bf23c85-f78e-4cfb-87f9-8f6c1d3cd5db tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.183707 Nov 16 16:19:17.033659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 291/612] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:16 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:17.167892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:17.179670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8e338921-4cb9-460b-a1bb-7e592fac1a06 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.165290 Nov 16 16:19:17.180553 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 322/613] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:17 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:17.192064 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b95cbf0e-49f0-4879-842f-cc1d637e0b76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:17.193145 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b95cbf0e-49f0-4879-842f-cc1d637e0b76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:17.200948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b95cbf0e-49f0-4879-842f-cc1d637e0b76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:17.201398 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b95cbf0e-49f0-4879-842f-cc1d637e0b76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:17.202415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b95cbf0e-49f0-4879-842f-cc1d637e0b76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:17.202862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b95cbf0e-49f0-4879-842f-cc1d637e0b76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:17.291885 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b95cbf0e-49f0-4879-842f-cc1d637e0b76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.102838 Nov 16 16:19:17.292782 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 292/614] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:17 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:19:17.972367 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-42ad35b2-48ac-412c-ab51-e28414f7a7f6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:17.973305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-42ad35b2-48ac-412c-ab51-e28414f7a7f6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:17.981163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42ad35b2-48ac-412c-ab51-e28414f7a7f6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:17.981750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42ad35b2-48ac-412c-ab51-e28414f7a7f6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:17.982831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42ad35b2-48ac-412c-ab51-e28414f7a7f6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:17.983325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42ad35b2-48ac-412c-ab51-e28414f7a7f6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:18.041453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-42ad35b2-48ac-412c-ab51-e28414f7a7f6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073172 Nov 16 16:19:18.042040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 323/615] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:17 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:18.051799 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:18.052498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:18.059885 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:18.060343 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:18.061133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:18.061563 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:18.201296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:18.201996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:18.208337 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:18.208768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:18.209575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:18.210288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:18.213973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:18.223563 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-91dd286a-a1cd-45f0-b779-18ab391ded57 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.175663 Nov 16 16:19:18.235334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 293/616] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:18 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:18.304912 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2c87a29d-08f9-4e6f-b96c-a90d915dcaad tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:18.305871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2c87a29d-08f9-4e6f-b96c-a90d915dcaad tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:18.312372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c87a29d-08f9-4e6f-b96c-a90d915dcaad tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:18.312818 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c87a29d-08f9-4e6f-b96c-a90d915dcaad tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:18.313601 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c87a29d-08f9-4e6f-b96c-a90d915dcaad tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:18.314027 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c87a29d-08f9-4e6f-b96c-a90d915dcaad tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:18.352881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:18.361523 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-639f1470-e6bb-4891-937a-10598f3c22ab tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.164821 Nov 16 16:19:18.362098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 324/617] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:18 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:19.053065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1c5d0086-05f7-4a96-948c-4c09f543b4ee tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:19.053991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1c5d0086-05f7-4a96-948c-4c09f543b4ee tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:19.061321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1c5d0086-05f7-4a96-948c-4c09f543b4ee tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:19.061769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1c5d0086-05f7-4a96-948c-4c09f543b4ee tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:19.062578 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1c5d0086-05f7-4a96-948c-4c09f543b4ee tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:19.063011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1c5d0086-05f7-4a96-948c-4c09f543b4ee tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:19.099176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1c5d0086-05f7-4a96-948c-4c09f543b4ee tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049876 Nov 16 16:19:19.099781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 325/618] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:19 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:19.244842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:19.245695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:19.252521 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:19.253022 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:19.253780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:19.254206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:19.400130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:19.407742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-591d469e-761e-4072-9c7e-a53a37a6db0d tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.169104 Nov 16 16:19:19.408303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 326/619] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:19 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:19.417415 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:19.417415 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:19.418956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:19.419392 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:19.420153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:19.420879 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:19.568112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:19.577043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ff736cde-cf89-4423-88a7-e7eda70cec99 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.167799 Nov 16 16:19:19.577610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 327/620] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:19 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:20.114581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-111d73bf-057a-4dcd-8d0a-ffe536f885de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:20.115574 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-111d73bf-057a-4dcd-8d0a-ffe536f885de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:20.124996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-111d73bf-057a-4dcd-8d0a-ffe536f885de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:20.125598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-111d73bf-057a-4dcd-8d0a-ffe536f885de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:20.126786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-111d73bf-057a-4dcd-8d0a-ffe536f885de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:20.127303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-111d73bf-057a-4dcd-8d0a-ffe536f885de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:20.183443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-111d73bf-057a-4dcd-8d0a-ffe536f885de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074697 Nov 16 16:19:20.184018 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 328/621] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:20 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:20.429143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:20.430085 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:20.440454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:20.441196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:20.442472 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:20.443274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:20.592164 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:20.603957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-755137fa-44aa-4426-8f18-25af170de17f tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.181016 Nov 16 16:19:20.604895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 329/622] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:20 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:20.609586 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:20.610414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:20.617800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:20.618498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:20.619714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:20.620347 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:20.775573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:20.784661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cdd73782-2104-4f95-bd4c-c1c21f042224 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.178628 Nov 16 16:19:20.785222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 330/623] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:20 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:21.199404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d25ba4af-8b84-4b55-b154-dbf7884b3673 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:21.200302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d25ba4af-8b84-4b55-b154-dbf7884b3673 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:21.207233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d25ba4af-8b84-4b55-b154-dbf7884b3673 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:21.207674 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d25ba4af-8b84-4b55-b154-dbf7884b3673 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:21.208430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d25ba4af-8b84-4b55-b154-dbf7884b3673 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:21.208853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d25ba4af-8b84-4b55-b154-dbf7884b3673 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:21.238636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d25ba4af-8b84-4b55-b154-dbf7884b3673 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045750 Nov 16 16:19:21.239180 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 331/624] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:21 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:21.624019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:21.624600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:21.631105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:21.631566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:21.632312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:21.632735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:21.773807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:21.781954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d82e06c9-587e-46e3-af3d-41ea4c185aff tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.163535 Nov 16 16:19:21.782551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 332/625] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:21 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:21.804270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:21.805093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:21.813083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:21.813525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:21.814300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:21.814764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:21.954119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:21.966411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1fc4ea52-4ae9-476e-8d52-835d7adfa21b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.167788 Nov 16 16:19:21.967242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 333/626] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:21 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:22.251962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c86f5c6b-8f66-4821-b932-3d22f9da2d53 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:22.252810 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c86f5c6b-8f66-4821-b932-3d22f9da2d53 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:22.259661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c86f5c6b-8f66-4821-b932-3d22f9da2d53 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:22.260100 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c86f5c6b-8f66-4821-b932-3d22f9da2d53 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:22.260896 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c86f5c6b-8f66-4821-b932-3d22f9da2d53 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:22.261319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c86f5c6b-8f66-4821-b932-3d22f9da2d53 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:22.291930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c86f5c6b-8f66-4821-b932-3d22f9da2d53 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043900 Nov 16 16:19:22.292476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 334/627] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:22 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:19:22.811134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:22.812102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:22.822494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:22.823146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:22.824434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:22.825151 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:22.971018 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:22.978411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7660880d-b73d-49be-9a83-e6b10e09daf9 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.173848 Nov 16 16:19:22.978998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 335/628] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:22 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:22.988385 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:22.989143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:22.998564 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:22.999008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:22.999780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:23.000210 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:23.152100 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:23.160786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-05d4e07b-1160-4cf8-aa60-12860aef8726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.175899 Nov 16 16:19:23.161603 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 336/629] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:22 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:23.309334 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5e559533-4401-478b-8675-2e93a8b4d347 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:23.310850 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5e559533-4401-478b-8675-2e93a8b4d347 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:23.321033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5e559533-4401-478b-8675-2e93a8b4d347 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:23.321764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5e559533-4401-478b-8675-2e93a8b4d347 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:23.323095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5e559533-4401-478b-8675-2e93a8b4d347 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:23.323798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5e559533-4401-478b-8675-2e93a8b4d347 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:23.355323 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5e559533-4401-478b-8675-2e93a8b4d347 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052358 Nov 16 16:19:23.355790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 337/630] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:23 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:23.796234 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2c87a29d-08f9-4e6f-b96c-a90d915dcaad tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 5.494897 Nov 16 16:19:23.796967 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 294/631] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:18 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 5496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:23.998847 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:23.999684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:24.009027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.009704 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:24.010921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.011568 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:24.169618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:24.177917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1942abc7-69a7-4aab-81ce-f2ba55987723 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.184798 Nov 16 16:19:24.178659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 338/632] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:23 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:24.181666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:24.182785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:24.195035 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.195784 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:24.197077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.197630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:24.339602 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:24.348178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a0f9985e-d9f6-43d6-8168-f52e77c776c4 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.173594 Nov 16 16:19:24.348751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 295/633] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:24 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:24.367311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e6552e31-6c63-41a7-bc55-3e2dd790cc4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:24.368316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e6552e31-6c63-41a7-bc55-3e2dd790cc4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:24.375201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6552e31-6c63-41a7-bc55-3e2dd790cc4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.375638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6552e31-6c63-41a7-bc55-3e2dd790cc4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:24.376409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6552e31-6c63-41a7-bc55-3e2dd790cc4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.376837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e6552e31-6c63-41a7-bc55-3e2dd790cc4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:24.417342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e6552e31-6c63-41a7-bc55-3e2dd790cc4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053822 Nov 16 16:19:24.417901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 339/634] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:24 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:19:24.808738 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-52334e37-a12c-4023-9d28-f53572f1c80a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:24.809697 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-52334e37-a12c-4023-9d28-f53572f1c80a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:24.816752 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52334e37-a12c-4023-9d28-f53572f1c80a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.817210 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52334e37-a12c-4023-9d28-f53572f1c80a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:24.817976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52334e37-a12c-4023-9d28-f53572f1c80a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:24.818421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52334e37-a12c-4023-9d28-f53572f1c80a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:25.098911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-52334e37-a12c-4023-9d28-f53572f1c80a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.293784 Nov 16 16:19:25.099581 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 296/635] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:24 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:25.194734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:25.195389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:25.202067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:25.202507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:25.203276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:25.203698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:25.354614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:25.366055 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:25.366773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:25.369455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-aff18b34-6fa4-4b82-988b-3ed8db75a311 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1512 microversion: 2.1 time: 0.178352 Nov 16 16:19:25.370831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 340/636] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:25 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1512 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:25.383410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:25.384355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:25.384749 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:25.385190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:25.428361 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7531fdfd-38c0-4db0-aa4f-65ae61e7c7f0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:25.429316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7531fdfd-38c0-4db0-aa4f-65ae61e7c7f0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:25.435595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7531fdfd-38c0-4db0-aa4f-65ae61e7c7f0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:25.436034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7531fdfd-38c0-4db0-aa4f-65ae61e7c7f0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:25.436805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7531fdfd-38c0-4db0-aa4f-65ae61e7c7f0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:25.437232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7531fdfd-38c0-4db0-aa4f-65ae61e7c7f0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:25.466145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7531fdfd-38c0-4db0-aa4f-65ae61e7c7f0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041380 Nov 16 16:19:25.466640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 341/637] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:19:25 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:19:25.528875 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:25.537362 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-54a96224-9271-4dc7-8cf5-45009f997ddc tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.175564 Nov 16 16:19:25.537924 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 297/638] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:25 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:25.636036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-571393958", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "87532d28-954d-488e-beef-2ed2275c6575"}]}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:25.687679 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] validate_networks() for [('87532d28-954d-488e-beef-2ed2275c6575', None, None, None, None, None)] {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:19:26.066498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:19:26.066979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:19:26.067449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:19:26.067849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:19:26.068359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:19:26.079255 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.080024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.080851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.081329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.101432 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:19:26.105919 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Getting quotas for user 99d58fe781aa40b2abf368dcc69b1a53 and project a29ddd96b66c433b981df5387fb540bd. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:19:26.112345 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9d1d007a-730e-4f84-a46c-0c9ec49eef52 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:26.113418 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9d1d007a-730e-4f84-a46c-0c9ec49eef52 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:26.118775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:19:26.121248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:19:26.121472 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1d007a-730e-4f84-a46c-0c9ec49eef52 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.122074 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1d007a-730e-4f84-a46c-0c9ec49eef52 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.123233 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1d007a-730e-4f84-a46c-0c9ec49eef52 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.123866 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d1d007a-730e-4f84-a46c-0c9ec49eef52 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.187396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e2c72a29-6eca-4de5-9f21-e9c67d274010 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555056 Nov 16 16:19:26.188124 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 342/639] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:19:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:19:26.198304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5657fb40-30b8-4ad5-86ec-ad09b751f4a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:26.198949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5657fb40-30b8-4ad5-86ec-ad09b751f4a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:26.205757 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9d1d007a-730e-4f84-a46c-0c9ec49eef52 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.096997 Nov 16 16:19:26.208342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 298/640] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:26 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:26.244870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-a0708b52-102b-4b0a-8dde-4b80d5bb5659 req-4a17a652-ff25-4626-ad6e-5b032d4d49d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b5a028c-3cac-418b-bf82-6171c049f94e", "name": "network-vif-deleted", "tag": "4cd0124a-a76f-447f-ad3d-090da419460b"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:26.246571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:19:26.246571 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:19:26.255175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a0708b52-102b-4b0a-8dde-4b80d5bb5659 req-4a17a652-ff25-4626-ad6e-5b032d4d49d3 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.255616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-a0708b52-102b-4b0a-8dde-4b80d5bb5659 req-4a17a652-ff25-4626-ad6e-5b032d4d49d3 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.267614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-a0708b52-102b-4b0a-8dde-4b80d5bb5659 req-4a17a652-ff25-4626-ad6e-5b032d4d49d3 service nova] Creating event network-vif-deleted:4cd0124a-a76f-447f-ad3d-090da419460b for instance 5b5a028c-3cac-418b-bf82-6171c049f94e on hv-cinder-78776 Nov 16 16:19:26.273419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-a0708b52-102b-4b0a-8dde-4b80d5bb5659 req-4a17a652-ff25-4626-ad6e-5b032d4d49d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032398 Nov 16 16:19:26.274177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 299/641] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:19:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:19:26.277115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5657fb40-30b8-4ad5-86ec-ad09b751f4a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:26.283815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5657fb40-30b8-4ad5-86ec-ad09b751f4a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1217 microversion: 2.1 time: 0.089217 Nov 16 16:19:26.284431 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 343/642] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:26 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:26.387927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:26.388625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:26.396666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.397348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.398155 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.398629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.450191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.450666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.451137 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lazy-loading 'fault' on Instance uuid 5b5a028c-3cac-418b-bf82-6171c049f94e {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:19:26.499230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:26.507948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d7f1c8c3-29ac-4eac-8dff-744dd22a9d16 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 200 len: 1308 microversion: 2.1 time: 0.124302 Nov 16 16:19:26.508524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 300/643] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:26 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:26.556014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:26.557192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:26.563624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.564068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.564856 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:26.565283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:26.782346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:26.790891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-326b3be1-ecc7-4a29-8df5-bdbbdfb0bc07 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.239613 Nov 16 16:19:26.791811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 344/644] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:26 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:27.221503 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6bfd3d53-82e0-4024-b059-b526482a820a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:27.222434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6bfd3d53-82e0-4024-b059-b526482a820a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:27.229609 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfd3d53-82e0-4024-b059-b526482a820a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.230059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfd3d53-82e0-4024-b059-b526482a820a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.230853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfd3d53-82e0-4024-b059-b526482a820a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.231283 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bfd3d53-82e0-4024-b059-b526482a820a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.298860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6bfd3d53-82e0-4024-b059-b526482a820a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.080967 Nov 16 16:19:27.299484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 301/645] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:27 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:27.300744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:27.301424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:27.308190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.308659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.309466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.309896 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.370946 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:27.379803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0c9e24eb-0633-4c70-a347-e2fdf95cf0c1 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1269 microversion: 2.1 time: 0.082815 Nov 16 16:19:27.380406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 345/646] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:27 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:27.526012 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:27.527198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 5b5a028c-3cac-418b-bf82-6171c049f94e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:27.534606 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.535053 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.536063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.536495 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.555054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] HTTP exception thrown: Instance 5b5a028c-3cac-418b-bf82-6171c049f94e could not be found. Nov 16 16:19:27.555776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Returning 404 to user: Instance 5b5a028c-3cac-418b-bf82-6171c049f94e could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:19:27.557132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-987369be-8a02-44aa-92aa-96e3b445f861 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e" status: 404 len: 111 microversion: 2.1 time: 0.035335 Nov 16 16:19:27.557604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 302/647] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:27 2021] GET /compute/v2.1/servers/5b5a028c-3cac-418b-bf82-6171c049f94e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:19:27.808325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:27.808928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:27.816757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.817287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.818243 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:27.818863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:27.956989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:27.965456 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c0bde39a-4fe7-44fe-b12e-dcf2fdde7f29 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.160746 Nov 16 16:19:27.966209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 346/648] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:27 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:28.310846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4127c30b-6a3f-495c-b845-3c8a42859f89 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:28.311682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4127c30b-6a3f-495c-b845-3c8a42859f89 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:28.319178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4127c30b-6a3f-495c-b845-3c8a42859f89 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:28.319178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4127c30b-6a3f-495c-b845-3c8a42859f89 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:28.319956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4127c30b-6a3f-495c-b845-3c8a42859f89 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:28.320387 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4127c30b-6a3f-495c-b845-3c8a42859f89 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:28.397385 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:28.398058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:28.404930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:28.405365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:28.406205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:28.406593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:28.466825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:28.475620 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e3974493-4781-496f-89bd-ac363c6e0c6c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1277 microversion: 2.1 time: 0.082386 Nov 16 16:19:28.476774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 347/649] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:28 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1277 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:28.983266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:28.983959 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:28.990863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:28.991319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:28.992105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:28.992533 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:29.204623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:29.213872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a3166523-2d59-443c-8fda-c868d1e32339 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.234567 Nov 16 16:19:29.214490 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 348/650] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:28 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:29.492448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:29.493182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:29.499197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:29.499822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:29.500618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:29.501111 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:29.562534 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:29.571006 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c4d73770-c8b1-4519-9440-794c6fa1c170 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1287 microversion: 2.1 time: 0.082070 Nov 16 16:19:29.571796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 349/651] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:29 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:30.234443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:30.235144 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:30.247775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:30.248638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:30.249706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:30.250326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:30.404743 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:30.413657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ef799344-b06f-4126-8d4f-077b1f35aedb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.184434 Nov 16 16:19:30.414497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 350/652] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:30 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:30.588379 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:30.589283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:30.595322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:30.595769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:30.597086 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:30.598687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:30.668095 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:30.676251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1be7c06b-c5d9-44d6-a8e3-8830971fa8aa tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1287 microversion: 2.1 time: 0.091563 Nov 16 16:19:30.677087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 351/653] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:30 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:31.434284 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:31.436502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:31.444287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:31.444732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:31.445727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:31.446349 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:31.608886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:31.617575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7770339e-347f-43e0-8063-3748acf650e2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.189848 Nov 16 16:19:31.618484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 352/654] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:31 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:31.695957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:31.697093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:31.703502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:31.704212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:31.705737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:31.705893 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:31.782118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4127c30b-6a3f-495c-b845-3c8a42859f89 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 3.475077 Nov 16 16:19:31.783666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 303/655] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:28 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 3478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:31.808997 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:31.825655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2523001a-9fa0-4a9d-8624-e4fa42389033 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1287 microversion: 2.1 time: 0.132208 Nov 16 16:19:31.827227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 353/656] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:31 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:32.636916 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:32.637653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:32.650407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:32.654136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:32.657822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:32.659204 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:32.795407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-71d2f95d-2f2c-4728-ba1e-5a45f9e99c54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:32.796474 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-71d2f95d-2f2c-4728-ba1e-5a45f9e99c54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:32.806472 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71d2f95d-2f2c-4728-ba1e-5a45f9e99c54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:32.806991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71d2f95d-2f2c-4728-ba1e-5a45f9e99c54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:32.807873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71d2f95d-2f2c-4728-ba1e-5a45f9e99c54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:32.808308 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71d2f95d-2f2c-4728-ba1e-5a45f9e99c54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:32.853049 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:32.861822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e2810aa4-fa1d-445e-98f1-d6dc1e6d5726 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.229481 Nov 16 16:19:32.863204 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 304/657] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:32 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:32.868184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:32.869014 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:32.894358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:32.898695 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:32.899968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:32.901020 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:32.901416 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-71d2f95d-2f2c-4728-ba1e-5a45f9e99c54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.109530 Nov 16 16:19:32.902709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 354/658] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:32 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:19:33.024476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:33.034608 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0433cbe6-75ba-4d28-833c-09fe7a8256c2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1275 microversion: 2.1 time: 0.169862 Nov 16 16:19:33.036455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 305/659] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:32 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:33.880668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:33.884564 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:33.892745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:33.893197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:33.894491 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:33.894929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:33.914642 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c71d431a-40ea-459d-bc72-c52401f25d63 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:33.919057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c71d431a-40ea-459d-bc72-c52401f25d63 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:33.927104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-40ea-459d-bc72-c52401f25d63 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:33.927814 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-40ea-459d-bc72-c52401f25d63 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:33.928776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-40ea-459d-bc72-c52401f25d63 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:33.929368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c71d431a-40ea-459d-bc72-c52401f25d63 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:34.049466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:34.060612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3566b09f-ffa6-4b3a-9808-77693953e8df tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.184228 Nov 16 16:19:34.061529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 355/660] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:33 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:34.069384 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:34.070872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:34.077851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:34.078442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:34.079542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:34.079973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:34.221991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:34.237222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a646fbe9-9fb6-4356-bcf2-cdb9bb642e42 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.173999 Nov 16 16:19:34.238210 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 356/661] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:34 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:34.531627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-482ddfea-d200-437c-93f9-4febf859b686 req-ea7356e1-f3e7-44b0-95a4-cd76463d0d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d943e03-7c19-4b32-9128-be9653041cf1", "tag": "24f92f52-cc75-4491-8558-bf35946f36d3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:34.533164 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:19:34.533164 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:19:34.545481 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-482ddfea-d200-437c-93f9-4febf859b686 req-ea7356e1-f3e7-44b0-95a4-cd76463d0d69 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:34.545957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-482ddfea-d200-437c-93f9-4febf859b686 req-ea7356e1-f3e7-44b0-95a4-cd76463d0d69 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:34.557794 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-482ddfea-d200-437c-93f9-4febf859b686 req-ea7356e1-f3e7-44b0-95a4-cd76463d0d69 service nova] Creating event network-changed:24f92f52-cc75-4491-8558-bf35946f36d3 for instance 6d943e03-7c19-4b32-9128-be9653041cf1 on hv-cinder-78776 Nov 16 16:19:34.563531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-482ddfea-d200-437c-93f9-4febf859b686 req-ea7356e1-f3e7-44b0-95a4-cd76463d0d69 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035462 Nov 16 16:19:34.564486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 357/662] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:19:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:19:35.082763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:35.084673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:35.093029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:35.093920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:35.095321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:35.096011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:35.339949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:35.348907 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-700ffdf2-2729-4e0a-a294-a428d941e24d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.271043 Nov 16 16:19:35.349902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 358/663] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:35 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:35.355385 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:35.356263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:35.371739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:35.372526 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:35.373776 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:35.374741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:35.823947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:35.834705 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cdb71d0a-3187-49d1-bbc8-81ecb25878de tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.483466 Nov 16 16:19:35.835711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 359/664] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:35 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:36.370224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:36.370835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:36.388744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:36.388744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:36.388744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:36.388744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:36.625694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:36.635848 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-60f8acd8-5c1b-4ff8-afad-45cbefb5d99e tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.270495 Nov 16 16:19:36.636532 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 360/665] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:36 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:36.852446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:36.853057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:36.859181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:36.860080 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:36.861070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:36.861503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:37.085237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:37.093464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9df99a25-3113-49c2-9366-209c71ad5bb6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.244416 Nov 16 16:19:37.104796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 361/666] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:36 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:37.653618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:37.654996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:37.662138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:37.662764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:37.663619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:37.664117 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:38.200525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:38.209186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-90c0170a-4fc5-4f22-ab46-0bef176851f3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.559442 Nov 16 16:19:38.209760 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 362/667] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:37 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:38.222853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:38.223925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:38.232581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:38.234269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:38.235645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:38.236727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:38.331197 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c71d431a-40ea-459d-bc72-c52401f25d63 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 4.421256 Nov 16 16:19:38.335804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 306/668] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:33 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 4427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:38.662541 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:38.688708 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d40cea3e-710e-4456-a422-a2fc7894dc91 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.472350 Nov 16 16:19:38.693265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 363/669] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:38 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:39.228625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:39.229604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:39.245841 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:39.246490 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:39.247616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:39.249461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:39.345273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7c357a57-3b03-4ba6-9bd2-28dfe52bd2af tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:39.346240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7c357a57-3b03-4ba6-9bd2-28dfe52bd2af tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:39.371127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c357a57-3b03-4ba6-9bd2-28dfe52bd2af tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:39.371886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c357a57-3b03-4ba6-9bd2-28dfe52bd2af tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:39.373064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c357a57-3b03-4ba6-9bd2-28dfe52bd2af tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:39.373687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c357a57-3b03-4ba6-9bd2-28dfe52bd2af tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:39.556968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:39.569586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6d6437d2-bf6e-4935-b12f-1829bf3f5941 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.346003 Nov 16 16:19:39.571042 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 307/670] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:39 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:39.710681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:39.712025 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:39.723001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:39.723829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:39.725731 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:39.726442 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:39.928950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7c357a57-3b03-4ba6-9bd2-28dfe52bd2af tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.585974 Nov 16 16:19:39.933450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 364/671] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:39 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:39.988636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:39.996951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7c7f8121-b1b9-448c-bdda-4c8a0853b12f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.291159 Nov 16 16:19:39.997560 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 308/672] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:39 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:40.588559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:40.589547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:40.600275 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:40.600718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:40.604122 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:40.604583 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:40.669888 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6d88a34b-9c55-4fcc-b2a2-dd8ab3990f70 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Action: 'create', calling method: .version_select at 0x7f3ec3f2e550>, body: {"keypair": {"name": "tempest-TestShelveInstance-157657213"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:40.721294 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-6d88a34b-9c55-4fcc-b2a2-dd8ab3990f70 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Getting quotas for project 9e9e25e747f14010be9908f8ccb0712f. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:19:40.726245 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-6d88a34b-9c55-4fcc-b2a2-dd8ab3990f70 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Getting quotas for user 9ecde32d12664c48a8cff7bf839eb505 and project 9e9e25e747f14010be9908f8ccb0712f. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:19:40.869356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:40.882705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-acf7c33a-876d-48c4-aa6d-9399f8cb61d8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.297467 Nov 16 16:19:40.885035 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 309/673] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:40 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:40.942960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1075a46b-a42e-470f-a607-785a9f0b6e9a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:40.943892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1075a46b-a42e-470f-a607-785a9f0b6e9a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:40.954642 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1075a46b-a42e-470f-a607-785a9f0b6e9a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:40.955870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1075a46b-a42e-470f-a607-785a9f0b6e9a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:40.956964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1075a46b-a42e-470f-a607-785a9f0b6e9a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:40.957561 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1075a46b-a42e-470f-a607-785a9f0b6e9a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:41.067202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1075a46b-a42e-470f-a607-785a9f0b6e9a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.129740 Nov 16 16:19:41.071764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 310/674] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:40 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:19:41.079515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:41.080494 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:41.095897 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:41.097013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:41.097976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:41.098599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:41.193085 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-6d88a34b-9c55-4fcc-b2a2-dd8ab3990f70 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Getting quotas for project 9e9e25e747f14010be9908f8ccb0712f. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:19:41.198787 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-6d88a34b-9c55-4fcc-b2a2-dd8ab3990f70 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Getting quotas for user 9ecde32d12664c48a8cff7bf839eb505 and project 9e9e25e747f14010be9908f8ccb0712f. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:19:41.214682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6d88a34b-9c55-4fcc-b2a2-dd8ab3990f70 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.823423 Nov 16 16:19:41.221663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 365/675] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Nov 16 16:19:40 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:41.350005 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:41.358655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9cbfd1a0-3e58-4fed-b5c4-4a1413b00218 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.285440 Nov 16 16:19:41.359377 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 311/676] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:41 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:41.902875 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:41.903869 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:41.912286 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:41.913228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:41.914370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:41.915031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:42.085946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-397d7aa0-484b-4369-9b46-f99472f476bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:42.086989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-397d7aa0-484b-4369-9b46-f99472f476bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:42.110748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:42.118830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-397d7aa0-484b-4369-9b46-f99472f476bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:42.119484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-397d7aa0-484b-4369-9b46-f99472f476bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:42.120609 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-397d7aa0-484b-4369-9b46-f99472f476bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:42.121113 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-397d7aa0-484b-4369-9b46-f99472f476bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:42.144394 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b40a3df2-655b-43ad-8073-28d21e7a1637 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.241312 Nov 16 16:19:42.150079 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 366/677] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:41 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:42.376922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:42.377914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:42.393021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:42.395304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:42.398122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:42.399404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:42.649292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:42.666080 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ee41b1f0-d2b7-450c-aff6-0b4b4f6fcfa5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.286544 Nov 16 16:19:42.666796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 367/678] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:42 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:42.810236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-397d7aa0-484b-4369-9b46-f99472f476bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.733643 Nov 16 16:19:42.811173 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 312/679] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:42 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:43.167413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:43.167413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:43.173781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:43.174238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:43.175040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:43.175575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:43.331006 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:43.344350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7938f624-9ab3-472d-a69d-da586717fb10 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.178962 Nov 16 16:19:43.347015 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 368/680] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:43 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:43.685960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:43.686680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:43.694059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:43.694562 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:43.695416 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:43.695743 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:43.822525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c54f1953-fa60-4448-bf91-c89bdbf37bb6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:43.823590 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c54f1953-fa60-4448-bf91-c89bdbf37bb6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:43.830989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c54f1953-fa60-4448-bf91-c89bdbf37bb6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:43.831435 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c54f1953-fa60-4448-bf91-c89bdbf37bb6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:43.832241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c54f1953-fa60-4448-bf91-c89bdbf37bb6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:43.832753 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c54f1953-fa60-4448-bf91-c89bdbf37bb6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:43.845648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:43.853308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-aeb8d85e-a290-4108-8a97-d422166d19a7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.171691 Nov 16 16:19:43.853901 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 313/681] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:43 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:44.366944 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:44.367473 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:44.374257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:44.374730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:44.375488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:44.375919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:44.522158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:44.530607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-31245927-f77e-4574-bf6e-16357278fa3a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.169203 Nov 16 16:19:44.531162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 314/682] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:44 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:44.872476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:44.873103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:44.880195 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:44.880638 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:44.881408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:44.881838 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:45.019767 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:45.027213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6a36c410-566d-4096-8a18-bc4ce97b6fd2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.158831 Nov 16 16:19:45.027769 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 315/683] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:44 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:45.548952 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:45.550146 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:45.559676 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:45.560363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:45.561379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:45.561976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:45.714762 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:45.727753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-85cb4a4b-d0b3-4aff-a8a1-cd33298aeca5 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.183704 Nov 16 16:19:45.728323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 316/684] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:45 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:46.048363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:46.049432 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:46.059874 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:46.060633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:46.062054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:46.062834 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:46.201719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:46.213498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-de183b63-70d6-4943-8bfe-79d56bd3dc0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.171723 Nov 16 16:19:46.214092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 317/685] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:46 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:46.613083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c54f1953-fa60-4448-bf91-c89bdbf37bb6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 2.793969 Nov 16 16:19:46.613745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 369/686] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:43 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 2796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:46.747296 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:46.748193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:46.758296 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:46.758985 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:46.759890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:46.760502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:46.908751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:46.916927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d197f68a-22de-44e5-bd85-43975c9d6a76 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1568 microversion: 2.1 time: 0.175498 Nov 16 16:19:46.917463 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 318/687] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:46 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:47.232555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:47.233427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:47.240820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:47.241260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:47.242036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:47.242486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:47.386475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:47.401461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3441a331-743e-4fcf-99bb-599193682ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.174078 Nov 16 16:19:47.402359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 370/688] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:47 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:47.624817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-30cc1547-d66f-4672-8116-05cb1a1b68a6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:47.625765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-30cc1547-d66f-4672-8116-05cb1a1b68a6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:47.632135 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30cc1547-d66f-4672-8116-05cb1a1b68a6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:47.632596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30cc1547-d66f-4672-8116-05cb1a1b68a6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:47.633386 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30cc1547-d66f-4672-8116-05cb1a1b68a6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:47.633819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30cc1547-d66f-4672-8116-05cb1a1b68a6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:47.741203 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-30cc1547-d66f-4672-8116-05cb1a1b68a6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.119936 Nov 16 16:19:47.743644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 319/689] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:47 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:47.934185 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:47.934767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:47.941105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:47.941517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:47.942281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:47.942781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.004864 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1884477049", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "networks": [{"uuid": "d84afc5c-5a15-4a00-9306-51fa977143c5"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:48.064479 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] validate_networks() for [('d84afc5c-5a15-4a00-9306-51fa977143c5', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:19:48.092776 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:48.100998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-06afad00-b8ef-4838-8acb-5d22b8481e87 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1548 microversion: 2.1 time: 0.170568 Nov 16 16:19:48.112643 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 371/690] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:47 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:48.118935 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:48.119423 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:48.126963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.127441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.128228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.128624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.223038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] HTTP exception thrown: Cannot 'detach_volume' instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec while it is in vm_state rescued Nov 16 16:19:48.223759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Returning 409 to user: Cannot 'detach_volume' instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec while it is in vm_state rescued {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:19:48.225103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-de6ad9e2-cd92-4aa6-86df-e2ef15957fb2 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments/0fc3d4ee-108d-47d5-8aa1-6863dd3efc99" status: 409 len: 152 microversion: 2.1 time: 0.110212 Nov 16 16:19:48.225735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 372/691] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:19:48 2021] DELETE /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments/0fc3d4ee-108d-47d5-8aa1-6863dd3efc99 => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 16 16:19:48.234419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2192d933-9458-474e-8884-a052a3ec11f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:48.234940 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2192d933-9458-474e-8884-a052a3ec11f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:48.241701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2192d933-9458-474e-8884-a052a3ec11f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.242138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2192d933-9458-474e-8884-a052a3ec11f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.243057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2192d933-9458-474e-8884-a052a3ec11f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.243361 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2192d933-9458-474e-8884-a052a3ec11f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.314412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2192d933-9458-474e-8884-a052a3ec11f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action" status: 202 len: 0 microversion: 2.1 time: 0.083634 Nov 16 16:19:48.315454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 373/692] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:48 2021] POST /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:19:48.325323 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:48.326818 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:48.334882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.335652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.336427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.336830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.503040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:19:48.503896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:19:48.504532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:19:48.505096 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:19:48.505727 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:19:48.515193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.515614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.516584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.517173 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.535879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Getting quotas for project bd35ac8531424c33bb44b731249fdcde. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:19:48.540803 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Getting quotas for user f9f6fc7adb31457095b9e6cb4595390d and project bd35ac8531424c33bb44b731249fdcde. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:19:48.551676 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:19:48.554355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:19:48.561580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:48.571529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bf39e560-dbae-46f3-9124-1db5da87e5f9 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.251505 Nov 16 16:19:48.572167 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 374/693] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:48 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:48.591766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:48.592878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:48.599911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.600582 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.601379 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.601800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.605417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2447d678-6cb0-4564-b22c-2d9e6283dff2 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605336 Nov 16 16:19:48.607206 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 320/694] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:19:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:19:48.616127 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5dd1ac47-d44b-44d2-9e68-30d6f49b9ff4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:48.616738 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5dd1ac47-d44b-44d2-9e68-30d6f49b9ff4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:48.697540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5dd1ac47-d44b-44d2-9e68-30d6f49b9ff4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:48.708348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5dd1ac47-d44b-44d2-9e68-30d6f49b9ff4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1219 microversion: 2.1 time: 0.095659 Nov 16 16:19:48.710627 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 321/695] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:48 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:48.753302 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-033c2ad0-6b4c-4115-9d2a-ec0f38ce46de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:48.754350 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-033c2ad0-6b4c-4115-9d2a-ec0f38ce46de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:48.761754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-033c2ad0-6b4c-4115-9d2a-ec0f38ce46de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.762524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-033c2ad0-6b4c-4115-9d2a-ec0f38ce46de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.763851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-033c2ad0-6b4c-4115-9d2a-ec0f38ce46de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:48.765558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-033c2ad0-6b4c-4115-9d2a-ec0f38ce46de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:48.838464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:48.848405 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-87ade9e4-020b-423a-bd49-301875e0d343 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.263350 Nov 16 16:19:48.855950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 375/696] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:48 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:48.867408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-033c2ad0-6b4c-4115-9d2a-ec0f38ce46de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.117627 Nov 16 16:19:48.868401 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 322/697] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:48 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:19:49.592151 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:49.592769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:49.599176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.599659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:49.600553 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.600980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:49.725756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:49.726487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:49.733554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.734219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:49.735175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.735598 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:49.750034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:49.759120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2d37eaf7-4fee-4d34-a385-2b7fdf453416 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.170489 Nov 16 16:19:49.764429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 376/698] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:49 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:49.811014 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:49.818860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b96db802-7aa1-4527-8ee7-474491ea88e5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1271 microversion: 2.1 time: 0.097188 Nov 16 16:19:49.819395 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 323/699] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:49 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1271 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:49.866161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:49.866797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:49.872974 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.875515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:49.879839 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.880466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:49.887162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-51de805d-9aa9-489e-b29f-b31979afe823 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:49.889909 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-51de805d-9aa9-489e-b29f-b31979afe823 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:49.898323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51de805d-9aa9-489e-b29f-b31979afe823 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.899208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51de805d-9aa9-489e-b29f-b31979afe823 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:49.900335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51de805d-9aa9-489e-b29f-b31979afe823 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:49.900980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51de805d-9aa9-489e-b29f-b31979afe823 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:50.033201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:50.040896 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3fc83027-9ee2-474d-97d4-111aacd2f1af tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.178647 Nov 16 16:19:50.041465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 377/700] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:49 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:50.777021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:50.777626 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:50.784156 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:50.784609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:50.785388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:50.785823 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:50.919901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:50.928503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-815a1c84-e05c-49bc-abe5-29a3bdd960fd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.154691 Nov 16 16:19:50.928991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 378/701] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:50 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:50.933753 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:50.934514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:50.940844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:50.941196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:50.941934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:50.942369 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:51.005115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:51.015187 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fbf69638-7dc8-4dc1-8d03-db0131f50d2a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1271 microversion: 2.1 time: 0.085095 Nov 16 16:19:51.015767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 379/702] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:50 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:51.056911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:51.057531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:51.063609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:51.064064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:51.064831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:51.065262 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:51.211573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:51.219175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6f6d319a-7dd6-469f-99ac-496a5377ce0f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.166050 Nov 16 16:19:51.219846 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 380/703] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:51 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:51.945402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:51.946023 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:51.952661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:51.953119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:51.953950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:51.954394 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:52.121689 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:52.131055 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-244c3308-bdca-4c8d-a1db-c4c70fe2b9b3 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.189758 Nov 16 16:19:52.132332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 381/704] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:51 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:52.137012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:52.137992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:52.144511 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:52.144960 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:52.145745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:52.146433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:52.220730 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:52.228321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-afa23bc5-5200-479e-b205-788b5a904be3 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1271 microversion: 2.1 time: 0.094955 Nov 16 16:19:52.228881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 382/705] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:52 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:52.236194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:52.238160 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:52.244438 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:52.244884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:52.245670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:52.246103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:52.391086 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:52.400049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f02bef28-31ec-4629-9c9f-7d17ae1c604c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.167855 Nov 16 16:19:52.400757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 383/706] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:52 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:52.785443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-51df9273-ede5-432d-adb6-7e8f276fbd96 req-e0693ce3-3e98-4608-b3cf-d660a2bf8705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d943e03-7c19-4b32-9128-be9653041cf1", "name": "network-vif-plugged", "status": "completed", "tag": "24f92f52-cc75-4491-8558-bf35946f36d3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:52.787700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:19:52.787700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:19:52.805038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-51df9273-ede5-432d-adb6-7e8f276fbd96 req-e0693ce3-3e98-4608-b3cf-d660a2bf8705 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:52.805560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-51df9273-ede5-432d-adb6-7e8f276fbd96 req-e0693ce3-3e98-4608-b3cf-d660a2bf8705 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:52.819671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-51df9273-ede5-432d-adb6-7e8f276fbd96 req-e0693ce3-3e98-4608-b3cf-d660a2bf8705 service nova] Creating event network-vif-plugged:24f92f52-cc75-4491-8558-bf35946f36d3 for instance 6d943e03-7c19-4b32-9128-be9653041cf1 on hv-cinder-78776 Nov 16 16:19:52.825315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-51df9273-ede5-432d-adb6-7e8f276fbd96 req-e0693ce3-3e98-4608-b3cf-d660a2bf8705 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043695 Nov 16 16:19:52.825969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 384/707] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:19:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:19:53.150645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:53.152042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:53.158120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:53.158597 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:53.159365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:53.159789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:53.307670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:53.315732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4bacdafc-6f30-4057-9b50-c29318903ad0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.169923 Nov 16 16:19:53.316282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 385/708] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:53 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:53.322820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:53.323417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:53.329082 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:53.329516 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:53.333205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:53.333205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:53.394492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:53.401902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e75379b3-d33c-4eea-b8d2-a5aa1899c1b4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1271 microversion: 2.1 time: 0.082712 Nov 16 16:19:53.402486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 386/709] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:53 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:53.418218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:53.418891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:53.425389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:53.425731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:53.426572 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:53.427161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:53.566718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:53.574783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-48c9a4cc-7dad-4808-92d1-bd528dfdeab7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.160772 Nov 16 16:19:53.575346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 387/710] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:53 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:54.336827 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:54.337822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:54.348033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:54.348739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:54.350010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:54.350479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:54.488528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:54.500697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2295cbbf-81fe-42d3-a0ee-5b6e02ffb4cb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.170201 Nov 16 16:19:54.501396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 388/711] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:54 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:54.506162 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:54.506873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:54.517735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:54.518180 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:54.519324 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:54.519755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:54.580252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:54.588151 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b31f09ce-8428-4f99-bea5-91ef5a043538 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1271 microversion: 2.1 time: 0.085621 Nov 16 16:19:54.588822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 389/712] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:54 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:54.593358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:54.594155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:54.600629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:54.601058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:54.601830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:54.602268 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:54.744438 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:54.751798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8db36f64-d138-4e90-8ab9-7161899f4f46 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.161952 Nov 16 16:19:54.752346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 390/713] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:54 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:55.521228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:55.522064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:55.529979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:55.530478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:55.531276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:55.531701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:55.673451 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:55.683254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-52b3abe8-0f98-4e62-9a07-7711a28f7af0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.167059 Nov 16 16:19:55.684075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 391/714] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:55 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:55.688124 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:55.688718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:55.695150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:55.695588 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:55.696683 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:55.697333 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:55.760197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:55.767767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ca29b491-ba93-444a-b1d4-85d656cf47d1 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1271 microversion: 2.1 time: 0.082879 Nov 16 16:19:55.768710 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 392/715] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:55 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:55.773028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:55.773554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:55.779303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:55.779738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:55.780542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:55.780965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:55.927944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:55.943894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-20a61b0c-32dd-4957-bccc-aef70cbc6956 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.173819 Nov 16 16:19:55.947994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 393/716] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:55 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:56.011011 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-51de805d-9aa9-489e-b29f-b31979afe823 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 6.131910 Nov 16 16:19:56.015310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 324/717] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:49 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 6135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:56.701782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:56.703359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:56.710476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:56.710945 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:56.711796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:56.712341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:56.786609 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:56.787359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:56.795915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:56.796412 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:56.797529 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:56.797742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:56.891171 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:56.899589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b22bb37b-5f7d-42ff-9393-b7f8eadc69cb tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1277 microversion: 2.1 time: 0.117974 Nov 16 16:19:56.900351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 325/718] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:56 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:56.912711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:56.921434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b4a6320e-ea9f-4a61-a9c2-74a2631b1a8c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.223564 Nov 16 16:19:56.922203 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 394/719] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:56 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:56.966464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:56.967063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:56.973818 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:56.974255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:56.975101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:56.975530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:57.023833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cd9e3bf9-04c9-4155-8671-1becc4767920 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:57.025281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cd9e3bf9-04c9-4155-8671-1becc4767920 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:57.032118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cd9e3bf9-04c9-4155-8671-1becc4767920 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:57.032662 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cd9e3bf9-04c9-4155-8671-1becc4767920 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:57.033714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cd9e3bf9-04c9-4155-8671-1becc4767920 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:57.034253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cd9e3bf9-04c9-4155-8671-1becc4767920 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:57.128526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:57.139998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-22bdba33-5f79-4d37-9dfa-c43af58c3f1d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.175480 Nov 16 16:19:57.139998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 326/720] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:56 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:57.485988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cd9e3bf9-04c9-4155-8671-1becc4767920 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.465907 Nov 16 16:19:57.486725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 395/721] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:57 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:57.917246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:57.917964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:57.924519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:57.924968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:57.925715 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:57.926177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:57.939835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:57.941110 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:57.948750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:57.949436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:57.950246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:57.950701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:58.150135 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:58.152042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:58.160087 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e9f277fc-0f9f-44c0-956e-5063d42eb178 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.246454 Nov 16 16:19:58.161118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 327/722] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:57 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:58.166277 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:58.167010 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:58.171042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bdf003f9-065e-4237-8f87-ae8b950b0c09 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.235192 Nov 16 16:19:58.180756 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 396/723] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:57 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:58.180956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:58.180956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:58.180956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:58.180956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:58.319202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-1362c307-0035-4ebe-b75c-d2cb8bb72ce6 req-e98e6891-bcaf-4470-954d-9bf6ca08af20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bec3e44-7feb-44da-a4d2-6655f7643bf0", "tag": "ea81c752-5dfa-4fa2-8b4d-f74a733ab1c1"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:58.320956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:19:58.320956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:19:58.338352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1362c307-0035-4ebe-b75c-d2cb8bb72ce6 req-e98e6891-bcaf-4470-954d-9bf6ca08af20 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:58.338802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1362c307-0035-4ebe-b75c-d2cb8bb72ce6 req-e98e6891-bcaf-4470-954d-9bf6ca08af20 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:58.356627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-1362c307-0035-4ebe-b75c-d2cb8bb72ce6 req-e98e6891-bcaf-4470-954d-9bf6ca08af20 service nova] Creating event network-changed:ea81c752-5dfa-4fa2-8b4d-f74a733ab1c1 for instance 1bec3e44-7feb-44da-a4d2-6655f7643bf0 on hv-cinder-78776 Nov 16 16:19:58.364547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-1362c307-0035-4ebe-b75c-d2cb8bb72ce6 req-e98e6891-bcaf-4470-954d-9bf6ca08af20 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049155 Nov 16 16:19:58.367020 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 397/724] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:19:58.381884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:58.394460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-aa9fed25-b00c-42f5-8025-71fe4eb2d8c5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1317 microversion: 2.1 time: 0.232128 Nov 16 16:19:58.395024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 328/725] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:58 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:58.499835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e5c55489-ac62-483c-a46a-19a6a58a2012 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:58.501177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e5c55489-ac62-483c-a46a-19a6a58a2012 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:58.510887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5c55489-ac62-483c-a46a-19a6a58a2012 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:58.511584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5c55489-ac62-483c-a46a-19a6a58a2012 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:58.513116 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5c55489-ac62-483c-a46a-19a6a58a2012 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:58.514188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5c55489-ac62-483c-a46a-19a6a58a2012 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:58.601562 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e5c55489-ac62-483c-a46a-19a6a58a2012 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.107131 Nov 16 16:19:58.604598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 398/726] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:58 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:19:59.177355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:59.178130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:59.185512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.185986 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.186821 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.187243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.189218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:59.189911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:59.197247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.197710 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.198579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.199019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.391678 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:59.398069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:59.400437 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-83726883-4eba-4414-9621-dc559ca86f31 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.226941 Nov 16 16:19:59.401140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 329/727] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:59 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:59.407838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-023e93b4-1d5d-4b75-9217-63144fff085b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.222237 Nov 16 16:19:59.408370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 399/728] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:59 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:19:59.411589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:19:59.412191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:59.418406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.418905 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.419667 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.420099 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.580236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:19:59.591297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e605c9d4-a8e0-4a5d-a929-21a8af01865c tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1508 microversion: 2.1 time: 0.183528 Nov 16 16:19:59.591856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 330/729] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:19:59 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:19:59.614900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-777751f3-9e56-49d3-955a-7a708097053a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:19:59.616058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-777751f3-9e56-49d3-955a-7a708097053a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:19:59.623060 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-777751f3-9e56-49d3-955a-7a708097053a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.623506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-777751f3-9e56-49d3-955a-7a708097053a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.624321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-777751f3-9e56-49d3-955a-7a708097053a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:19:59.624754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-777751f3-9e56-49d3-955a-7a708097053a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:19:59.762763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-777751f3-9e56-49d3-955a-7a708097053a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.151150 Nov 16 16:19:59.763313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 400/730] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:19:59 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:00.425817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:00.426425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:00.429678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:00.430583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:00.433723 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.434174 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:00.435075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.435491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:00.439149 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.439599 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:00.440375 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.440809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:00.631429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:00.635480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:00.639725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2229d271-a631-41a9-9167-f17d5223189a tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.216937 Nov 16 16:20:00.640332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 401/731] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:00 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:00.644266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3cc9a99d-b20b-474e-b963-55f04bf1a7ad tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1556 microversion: 2.1 time: 0.222275 Nov 16 16:20:00.644881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 331/732] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:00 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1556 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:00.775757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-65853997-6b0e-41b5-aede-5daf7ad5f417 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:00.776745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-65853997-6b0e-41b5-aede-5daf7ad5f417 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:00.785886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-65853997-6b0e-41b5-aede-5daf7ad5f417 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.785886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-65853997-6b0e-41b5-aede-5daf7ad5f417 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:00.785886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-65853997-6b0e-41b5-aede-5daf7ad5f417 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.785886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-65853997-6b0e-41b5-aede-5daf7ad5f417 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:00.879214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-65853997-6b0e-41b5-aede-5daf7ad5f417 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.107182 Nov 16 16:20:00.883201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 402/733] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:00 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:00.971287 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-27b1e932-1e6c-4e8c-b7b7-fb34c8cbfded tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4d20734-35ce-486c-99c1-85480fed1e88"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:00.972411 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-27b1e932-1e6c-4e8c-b7b7-fb34c8cbfded tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:00.978852 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27b1e932-1e6c-4e8c-b7b7-fb34c8cbfded tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.979309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27b1e932-1e6c-4e8c-b7b7-fb34c8cbfded tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:00.980097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27b1e932-1e6c-4e8c-b7b7-fb34c8cbfded tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:00.980529 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-27b1e932-1e6c-4e8c-b7b7-fb34c8cbfded tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:01.232382 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-27b1e932-1e6c-4e8c-b7b7-fb34c8cbfded tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "POST /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265077 Nov 16 16:20:01.233055 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 332/734] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:20:00 2021] POST /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:01.660870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:01.661801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:01.662991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:01.663765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:01.670142 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:01.670320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:01.670618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:01.670830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:01.671413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:01.671615 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:01.671843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:01.672054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:02.098847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:02.109760 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:02.112524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d4780955-cb80-4bab-bad4-843b152af0d6 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1562 microversion: 2.1 time: 0.454549 Nov 16 16:20:02.113876 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 333/735] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:01 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1562 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:02.120536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-478d72cc-4d6b-4d6c-a714-32e6699cc890 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.466129 Nov 16 16:20:02.120752 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b4eaf1f8-be61-4feb-a9ae-406d9974ced0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:02.121623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b4eaf1f8-be61-4feb-a9ae-406d9974ced0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:02.130308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4eaf1f8-be61-4feb-a9ae-406d9974ced0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:02.130798 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4eaf1f8-be61-4feb-a9ae-406d9974ced0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:02.131861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4eaf1f8-be61-4feb-a9ae-406d9974ced0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:02.132288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4eaf1f8-be61-4feb-a9ae-406d9974ced0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:02.139535 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 403/736] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:01 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:02.204718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b4eaf1f8-be61-4feb-a9ae-406d9974ced0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.088690 Nov 16 16:20:02.205599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 334/737] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:02 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:02.210583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:02.211096 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:02.217460 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:02.217915 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:02.218741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:02.219455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:02.301628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lazy-loading 'services' on Instance uuid ca96c22d-d0ae-48e0-9f0f-fa02d0324fec {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:20:02.380189 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-93c95cb1-b1f9-4718-b715-61938259dd35 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments/0fc3d4ee-108d-47d5-8aa1-6863dd3efc99" status: 202 len: 0 microversion: 2.1 time: 0.173576 Nov 16 16:20:02.383981 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 404/738] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:20:02 2021] DELETE /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments/0fc3d4ee-108d-47d5-8aa1-6863dd3efc99 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:20:02.389823 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-25212fff-2649-4803-80d9-468b22f0329a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:02.390887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-25212fff-2649-4803-80d9-468b22f0329a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:02.398657 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25212fff-2649-4803-80d9-468b22f0329a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:02.399133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25212fff-2649-4803-80d9-468b22f0329a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:02.400289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25212fff-2649-4803-80d9-468b22f0329a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:02.400730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25212fff-2649-4803-80d9-468b22f0329a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:02.437581 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-25212fff-2649-4803-80d9-468b22f0329a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051973 Nov 16 16:20:02.438250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 335/739] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:02 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:03.141077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:03.141768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:03.148218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:03.148664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:03.149596 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:03.149973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:03.218900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9620dbe3-986c-4fb9-b978-57a632d91c25 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:03.220808 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9620dbe3-986c-4fb9-b978-57a632d91c25 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:03.235764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9620dbe3-986c-4fb9-b978-57a632d91c25 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:03.236477 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9620dbe3-986c-4fb9-b978-57a632d91c25 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:03.237453 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9620dbe3-986c-4fb9-b978-57a632d91c25 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:03.238320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9620dbe3-986c-4fb9-b978-57a632d91c25 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:03.304400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:03.316361 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9620dbe3-986c-4fb9-b978-57a632d91c25 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.101317 Nov 16 16:20:03.318461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 336/740] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:03 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:03.324626 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2af1cf5b-594f-4be0-8d2f-4d897117b521 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.187873 Nov 16 16:20:03.326007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 405/741] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:03 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:03.454524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-71bf23ae-c6af-42e1-9647-ed72d2a6224d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:03.456068 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-71bf23ae-c6af-42e1-9647-ed72d2a6224d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:03.473381 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71bf23ae-c6af-42e1-9647-ed72d2a6224d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:03.473802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71bf23ae-c6af-42e1-9647-ed72d2a6224d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:03.474835 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71bf23ae-c6af-42e1-9647-ed72d2a6224d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:03.475413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-71bf23ae-c6af-42e1-9647-ed72d2a6224d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:03.514812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-71bf23ae-c6af-42e1-9647-ed72d2a6224d tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064727 Nov 16 16:20:03.515901 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 337/742] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:03 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:04.329813 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-db427444-4333-4c0d-ad97-c25fe76c2ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:04.330785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-db427444-4333-4c0d-ad97-c25fe76c2ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:04.338075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db427444-4333-4c0d-ad97-c25fe76c2ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:04.338555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db427444-4333-4c0d-ad97-c25fe76c2ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:04.339341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db427444-4333-4c0d-ad97-c25fe76c2ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:04.339768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db427444-4333-4c0d-ad97-c25fe76c2ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:04.343425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:04.344112 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:04.350816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:04.351250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:04.352019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:04.352719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:04.411755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-db427444-4333-4c0d-ad97-c25fe76c2ba6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.085482 Nov 16 16:20:04.412379 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 406/743] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:04 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:04.516854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:04.525672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-964716d9-ac04-477c-a5be-adcd12d26b0b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.185775 Nov 16 16:20:04.526245 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 338/744] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:04 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:04.527555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0a8f632a-3da9-4f64-8c3d-24bd33e5fa94 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:04.528592 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0a8f632a-3da9-4f64-8c3d-24bd33e5fa94 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:04.535697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a8f632a-3da9-4f64-8c3d-24bd33e5fa94 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:04.535887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a8f632a-3da9-4f64-8c3d-24bd33e5fa94 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:04.536872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a8f632a-3da9-4f64-8c3d-24bd33e5fa94 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:04.537302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a8f632a-3da9-4f64-8c3d-24bd33e5fa94 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:04.575186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0a8f632a-3da9-4f64-8c3d-24bd33e5fa94 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051812 Nov 16 16:20:04.575762 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 407/745] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:04 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:20:05.424492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3e5306b5-b45d-48ba-91f1-d2a2bea72dde tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:05.425487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3e5306b5-b45d-48ba-91f1-d2a2bea72dde tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:05.433254 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e5306b5-b45d-48ba-91f1-d2a2bea72dde tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:05.433698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e5306b5-b45d-48ba-91f1-d2a2bea72dde tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:05.434489 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e5306b5-b45d-48ba-91f1-d2a2bea72dde tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:05.434911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e5306b5-b45d-48ba-91f1-d2a2bea72dde tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:05.543957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:05.544529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:05.551273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:05.551720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:05.552513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:05.552944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:05.603114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3e5306b5-b45d-48ba-91f1-d2a2bea72dde tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.181993 Nov 16 16:20:05.607813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 339/746] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:05 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:05.610302 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-92f13cf5-5e7c-4265-8ad2-1950d403e8a7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:05.611306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-92f13cf5-5e7c-4265-8ad2-1950d403e8a7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:05.619055 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f13cf5-5e7c-4265-8ad2-1950d403e8a7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:05.619495 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f13cf5-5e7c-4265-8ad2-1950d403e8a7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:05.620484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f13cf5-5e7c-4265-8ad2-1950d403e8a7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:05.620916 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-92f13cf5-5e7c-4265-8ad2-1950d403e8a7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:05.653964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-92f13cf5-5e7c-4265-8ad2-1950d403e8a7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048764 Nov 16 16:20:05.654575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 340/747] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:05 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:05.699422 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:05.706750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0393060a-7463-4c7b-93b0-77c8f818c764 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.167350 Nov 16 16:20:05.707311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 408/748] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:05 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:06.618063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4992967b-a1a1-486c-9d8e-9392e585f842 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:06.619590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4992967b-a1a1-486c-9d8e-9392e585f842 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:06.626691 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4992967b-a1a1-486c-9d8e-9392e585f842 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:06.627154 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4992967b-a1a1-486c-9d8e-9392e585f842 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:06.627928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4992967b-a1a1-486c-9d8e-9392e585f842 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:06.628363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4992967b-a1a1-486c-9d8e-9392e585f842 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:06.666082 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-50ea672e-293e-41d2-aa20-ed0d528ee124 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:06.667072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-50ea672e-293e-41d2-aa20-ed0d528ee124 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:06.673843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50ea672e-293e-41d2-aa20-ed0d528ee124 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:06.674285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50ea672e-293e-41d2-aa20-ed0d528ee124 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:06.675081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50ea672e-293e-41d2-aa20-ed0d528ee124 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:06.675504 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50ea672e-293e-41d2-aa20-ed0d528ee124 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:06.706300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-50ea672e-293e-41d2-aa20-ed0d528ee124 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Nov 16 16:20:06.707208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 409/749] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:06 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:06.723730 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:06.724330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:06.730770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:06.731252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:06.732276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:06.732681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:06.869759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:06.877857 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6f394766-d989-4f90-852c-e8ec7816a71b tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.157592 Nov 16 16:20:06.878402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 410/750] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:06 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:07.722185 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-190d871e-f5bc-431f-b31d-04de42ee7845 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:07.723727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-190d871e-f5bc-431f-b31d-04de42ee7845 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:07.733075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-190d871e-f5bc-431f-b31d-04de42ee7845 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:07.733704 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-190d871e-f5bc-431f-b31d-04de42ee7845 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:07.734718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-190d871e-f5bc-431f-b31d-04de42ee7845 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:07.735270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-190d871e-f5bc-431f-b31d-04de42ee7845 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:07.767218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-190d871e-f5bc-431f-b31d-04de42ee7845 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051481 Nov 16 16:20:07.767763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 411/751] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:07 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:07.896926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:07.897568 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:07.905289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:07.905851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:07.906842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:07.907370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:08.052777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:08.060739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5f86ea0f-3c15-4fc4-a870-1ffade81dee5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.168746 Nov 16 16:20:08.064806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 412/752] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:07 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:08.779374 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0b692173-a2c7-426c-9dbe-3e4d1919d207 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:08.780272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0b692173-a2c7-426c-9dbe-3e4d1919d207 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:08.787066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b692173-a2c7-426c-9dbe-3e4d1919d207 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:08.787513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b692173-a2c7-426c-9dbe-3e4d1919d207 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:08.788297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b692173-a2c7-426c-9dbe-3e4d1919d207 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:08.788727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b692173-a2c7-426c-9dbe-3e4d1919d207 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:08.819546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0b692173-a2c7-426c-9dbe-3e4d1919d207 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Nov 16 16:20:08.820083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 413/753] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:08 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:09.080975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:09.081994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:09.091049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:09.091502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:09.092295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:09.092728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:09.230894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:09.239100 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6d569e8f-cd86-48e6-bbcc-906030c2ff72 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.164451 Nov 16 16:20:09.239684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 414/754] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:09 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:09.453786 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4992967b-a1a1-486c-9d8e-9392e585f842 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 2.841523 Nov 16 16:20:09.454457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 341/755] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:06 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 2843 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:09.835298 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1e7a1cf5-50a3-4cc8-8310-f6b275ec7622 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:09.836799 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1e7a1cf5-50a3-4cc8-8310-f6b275ec7622 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:09.847575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e7a1cf5-50a3-4cc8-8310-f6b275ec7622 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:09.848329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e7a1cf5-50a3-4cc8-8310-f6b275ec7622 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:09.849594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e7a1cf5-50a3-4cc8-8310-f6b275ec7622 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:09.850300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e7a1cf5-50a3-4cc8-8310-f6b275ec7622 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:09.882358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1e7a1cf5-50a3-4cc8-8310-f6b275ec7622 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053528 Nov 16 16:20:09.882949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 415/756] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:09 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:10.260705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:10.262088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:10.275338 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:10.276082 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:10.277523 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:10.278136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:10.429077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:10.436909 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-312d76fd-e63e-4e43-bfcc-10d06d929464 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.182938 Nov 16 16:20:10.437459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 342/757] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:10 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:10.465311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8481a1b1-a7de-4051-99d7-499b24012acc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:10.466533 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8481a1b1-a7de-4051-99d7-499b24012acc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:10.474202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8481a1b1-a7de-4051-99d7-499b24012acc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:10.474744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8481a1b1-a7de-4051-99d7-499b24012acc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:10.475603 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8481a1b1-a7de-4051-99d7-499b24012acc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:10.476042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8481a1b1-a7de-4051-99d7-499b24012acc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:10.893871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4bdc2829-aa96-464a-a090-6b6db6a89044 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:10.894818 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4bdc2829-aa96-464a-a090-6b6db6a89044 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:10.901554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bdc2829-aa96-464a-a090-6b6db6a89044 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:10.901999 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bdc2829-aa96-464a-a090-6b6db6a89044 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:10.902822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bdc2829-aa96-464a-a090-6b6db6a89044 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:10.903339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bdc2829-aa96-464a-a090-6b6db6a89044 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:10.936719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4bdc2829-aa96-464a-a090-6b6db6a89044 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Nov 16 16:20:10.937465 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 343/758] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:10 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:11.204796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8481a1b1-a7de-4051-99d7-499b24012acc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.743121 Nov 16 16:20:11.207493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 416/759] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:10 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:11.457654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:11.458899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:11.469854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:11.470655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:11.471984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:11.472714 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:11.619325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:11.627920 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-00bd37c4-781d-4c91-952f-6342b58c6d22 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.176319 Nov 16 16:20:11.628397 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 344/760] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:11 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:11.954136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-356f5bec-c8de-4673-9138-40802e809288 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:11.955054 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-356f5bec-c8de-4673-9138-40802e809288 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:11.962306 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-356f5bec-c8de-4673-9138-40802e809288 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:11.962775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-356f5bec-c8de-4673-9138-40802e809288 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:11.963543 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-356f5bec-c8de-4673-9138-40802e809288 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:11.963967 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-356f5bec-c8de-4673-9138-40802e809288 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:11.996725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-356f5bec-c8de-4673-9138-40802e809288 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046871 Nov 16 16:20:11.997279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 417/761] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:11 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:12.216806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b5684b4b-705a-4551-9796-59fd284afd8c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:12.217619 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b5684b4b-705a-4551-9796-59fd284afd8c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:12.224535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5684b4b-705a-4551-9796-59fd284afd8c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:12.224981 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5684b4b-705a-4551-9796-59fd284afd8c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:12.225772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5684b4b-705a-4551-9796-59fd284afd8c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:12.226201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5684b4b-705a-4551-9796-59fd284afd8c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:12.321563 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b5684b4b-705a-4551-9796-59fd284afd8c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.108088 Nov 16 16:20:12.322445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 345/762] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:12 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:12.645081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:12.645672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:12.652165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:12.652658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:12.653457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:12.653888 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:12.793836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:12.802311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f7885ac1-9e5a-446f-8d80-26e9c20b37e0 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.161272 Nov 16 16:20:12.805798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 418/763] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:12 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:13.008703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b3087f56-491a-4415-9b22-ffdf610c37f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:13.009739 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b3087f56-491a-4415-9b22-ffdf610c37f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:13.017194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3087f56-491a-4415-9b22-ffdf610c37f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.017672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3087f56-491a-4415-9b22-ffdf610c37f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.018834 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3087f56-491a-4415-9b22-ffdf610c37f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.019451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b3087f56-491a-4415-9b22-ffdf610c37f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.051334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b3087f56-491a-4415-9b22-ffdf610c37f1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046872 Nov 16 16:20:13.052115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 346/764] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:13 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:13.080410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:13.080903 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:13.087397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.087839 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.088616 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.089043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.171488 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lazy-loading 'services' on Instance uuid 6d943e03-7c19-4b32-9128-be9653041cf1 {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:20:13.261094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-35018acf-366a-43b7-bb30-7083d66cc973 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments/c4d20734-35ce-486c-99c1-85480fed1e88" status: 202 len: 0 microversion: 2.1 time: 0.184397 Nov 16 16:20:13.261676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 419/765] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:20:13 2021] DELETE /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments/c4d20734-35ce-486c-99c1-85480fed1e88 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:20:13.273512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-351f5eee-86db-4c83-a123-26b008254cab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:13.274451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-351f5eee-86db-4c83-a123-26b008254cab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:13.281074 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-351f5eee-86db-4c83-a123-26b008254cab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.281524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-351f5eee-86db-4c83-a123-26b008254cab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.282299 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-351f5eee-86db-4c83-a123-26b008254cab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.282869 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-351f5eee-86db-4c83-a123-26b008254cab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.319527 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-351f5eee-86db-4c83-a123-26b008254cab tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051539 Nov 16 16:20:13.320147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 347/766] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:13 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:13.335057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-08339f4b-551f-4494-9806-273b0f1c6d51 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:13.336135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-08339f4b-551f-4494-9806-273b0f1c6d51 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:13.343069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08339f4b-551f-4494-9806-273b0f1c6d51 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.343519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08339f4b-551f-4494-9806-273b0f1c6d51 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.344309 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08339f4b-551f-4494-9806-273b0f1c6d51 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.344738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08339f4b-551f-4494-9806-273b0f1c6d51 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.417199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-08339f4b-551f-4494-9806-273b0f1c6d51 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.086032 Nov 16 16:20:13.417891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 420/767] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:13 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:13.760332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-bf51b94e-a29e-42de-91e0-69f4c1343476 req-808e33e7-27e8-4984-bd4c-b59b9eeea236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bec3e44-7feb-44da-a4d2-6655f7643bf0", "name": "network-vif-plugged", "status": "completed", "tag": "ea81c752-5dfa-4fa2-8b4d-f74a733ab1c1"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:13.762190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:13.762190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:20:13.770950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-bf51b94e-a29e-42de-91e0-69f4c1343476 req-808e33e7-27e8-4984-bd4c-b59b9eeea236 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.771381 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-bf51b94e-a29e-42de-91e0-69f4c1343476 req-808e33e7-27e8-4984-bd4c-b59b9eeea236 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.784241 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-bf51b94e-a29e-42de-91e0-69f4c1343476 req-808e33e7-27e8-4984-bd4c-b59b9eeea236 service nova] Creating event network-vif-plugged:ea81c752-5dfa-4fa2-8b4d-f74a733ab1c1 for instance 1bec3e44-7feb-44da-a4d2-6655f7643bf0 on hv-cinder-78776 Nov 16 16:20:13.790698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-bf51b94e-a29e-42de-91e0-69f4c1343476 req-808e33e7-27e8-4984-bd4c-b59b9eeea236 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034664 Nov 16 16:20:13.791625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 348/768] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:13.820792 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:13.821403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:13.828678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.829132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:13.834841 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:13.835332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:14.001866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:14.009725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-55bade34-72f3-4c5c-b929-1cfe5a68ee80 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.193604 Nov 16 16:20:14.010216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 421/769] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:13 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:14.064416 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-49d5e518-dab9-447d-ba9a-32c766ede8b1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:14.069425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-49d5e518-dab9-447d-ba9a-32c766ede8b1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:14.076742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d5e518-dab9-447d-ba9a-32c766ede8b1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:14.077187 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d5e518-dab9-447d-ba9a-32c766ede8b1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:14.078193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d5e518-dab9-447d-ba9a-32c766ede8b1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:14.078976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-49d5e518-dab9-447d-ba9a-32c766ede8b1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:14.111355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-49d5e518-dab9-447d-ba9a-32c766ede8b1 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052195 Nov 16 16:20:14.111966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 349/770] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:14 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:20:14.331831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-26a302a6-594f-41db-b80a-9e6b5c756fdd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:14.332942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-26a302a6-594f-41db-b80a-9e6b5c756fdd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:14.339748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-26a302a6-594f-41db-b80a-9e6b5c756fdd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:14.340204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-26a302a6-594f-41db-b80a-9e6b5c756fdd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:14.341209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-26a302a6-594f-41db-b80a-9e6b5c756fdd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:14.341647 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-26a302a6-594f-41db-b80a-9e6b5c756fdd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:14.374550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-26a302a6-594f-41db-b80a-9e6b5c756fdd tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Nov 16 16:20:14.375098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 422/771] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:14 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:14.429697 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-54015750-dede-47d1-900f-4b3341d88587 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:14.430650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-54015750-dede-47d1-900f-4b3341d88587 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:14.437242 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54015750-dede-47d1-900f-4b3341d88587 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:14.437701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54015750-dede-47d1-900f-4b3341d88587 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:14.438514 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54015750-dede-47d1-900f-4b3341d88587 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:14.438952 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54015750-dede-47d1-900f-4b3341d88587 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:14.737546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-54015750-dede-47d1-900f-4b3341d88587 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.311690 Nov 16 16:20:14.738255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 350/772] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:14 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:15.027347 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:15.027901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:15.035217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:15.035684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:15.037076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:15.037540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:15.183776 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:15.192387 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d5cbd1da-798b-41e5-9073-707fef41fa07 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.168874 Nov 16 16:20:15.192977 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 423/773] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:15 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:15.386552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2ce7c352-be67-42b2-b282-9be6c46170e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:15.387633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2ce7c352-be67-42b2-b282-9be6c46170e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:15.395660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ce7c352-be67-42b2-b282-9be6c46170e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:15.396099 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ce7c352-be67-42b2-b282-9be6c46170e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:15.396908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ce7c352-be67-42b2-b282-9be6c46170e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:15.397333 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ce7c352-be67-42b2-b282-9be6c46170e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:15.427269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2ce7c352-be67-42b2-b282-9be6c46170e0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Nov 16 16:20:15.427840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 351/774] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:15 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:20:15.750075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a2a4dfe2-fac4-4b6a-b1f8-2a8a2700c5b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:15.758561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a2a4dfe2-fac4-4b6a-b1f8-2a8a2700c5b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:15.758561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a2a4dfe2-fac4-4b6a-b1f8-2a8a2700c5b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:15.758561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a2a4dfe2-fac4-4b6a-b1f8-2a8a2700c5b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:15.758561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a2a4dfe2-fac4-4b6a-b1f8-2a8a2700c5b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:15.759036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a2a4dfe2-fac4-4b6a-b1f8-2a8a2700c5b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:15.849069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a2a4dfe2-fac4-4b6a-b1f8-2a8a2700c5b9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.102387 Nov 16 16:20:15.850514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 424/775] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:15 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:16.210066 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:16.210699 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:16.217002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:16.217483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:16.218239 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:16.218735 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:16.378120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:16.388193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4dcc2e67-076d-4457-9eeb-beb40e0c7306 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1319 microversion: 2.1 time: 0.182245 Nov 16 16:20:16.389113 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 352/776] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:16 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:16.617540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b76182c3-4343-4519-9f52-4c37401e54bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:16.619316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b76182c3-4343-4519-9f52-4c37401e54bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:16.627940 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b76182c3-4343-4519-9f52-4c37401e54bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:16.628588 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b76182c3-4343-4519-9f52-4c37401e54bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:16.629655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b76182c3-4343-4519-9f52-4c37401e54bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:16.630159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b76182c3-4343-4519-9f52-4c37401e54bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:16.660484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b76182c3-4343-4519-9f52-4c37401e54bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.226227 Nov 16 16:20:16.661261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 425/777] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:20:16 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1/os-volume_attachments => generated 25 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:20:16.863566 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2b2ea2a7-ec80-4887-bb4d-023c819213f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:16.864516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2b2ea2a7-ec80-4887-bb4d-023c819213f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:16.871283 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b2ea2a7-ec80-4887-bb4d-023c819213f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:16.871805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b2ea2a7-ec80-4887-bb4d-023c819213f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:16.872655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b2ea2a7-ec80-4887-bb4d-023c819213f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:16.873154 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2b2ea2a7-ec80-4887-bb4d-023c819213f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:16.980704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2b2ea2a7-ec80-4887-bb4d-023c819213f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.119978 Nov 16 16:20:16.980704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 353/778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:16 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:20:17.405449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:17.406062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:17.412914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:17.413496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:17.414291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:17.414770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:17.678961 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:17.687781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-07ee0610-8868-4978-8473-6e482699ca42 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1507 microversion: 2.1 time: 0.286432 Nov 16 16:20:17.688354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 426/779] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:17 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:17.705326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f6e0539-d798-4268-b38e-bdc06d5f0a20 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af533b38-1186-4503-bcf2-7b60fee2203d", "device": "/dev/sdb"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:17.706631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6f6e0539-d798-4268-b38e-bdc06d5f0a20 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:17.713765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6e0539-d798-4268-b38e-bdc06d5f0a20 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:17.714205 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6e0539-d798-4268-b38e-bdc06d5f0a20 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:17.715200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6e0539-d798-4268-b38e-bdc06d5f0a20 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:17.715802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f6e0539-d798-4268-b38e-bdc06d5f0a20 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:17.887629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:17.888118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:17.895599 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:17.896105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:17.896947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:17.897436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:17.924713 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:20:18.014730 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-91ace086-58f1-44c0-93d3-d6947301f873 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 204 len: 0 microversion: 2.1 time: 0.129130 Nov 16 16:20:18.016069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 427/780] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:20:17 2021] DELETE /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:20:18.024377 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9707999d-24ce-4727-b64e-db519ecb9418 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:18.026133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9707999d-24ce-4727-b64e-db519ecb9418 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:18.032889 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9707999d-24ce-4727-b64e-db519ecb9418 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.033402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9707999d-24ce-4727-b64e-db519ecb9418 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.034284 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9707999d-24ce-4727-b64e-db519ecb9418 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.034742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9707999d-24ce-4727-b64e-db519ecb9418 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.093675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f6e0539-d798-4268-b38e-bdc06d5f0a20 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "POST /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391936 Nov 16 16:20:18.094405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 354/781] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:20:17 2021] POST /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0/os-volume_attachments => generated 194 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:18.100492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:18.101274 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:18.111528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.112166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9707999d-24ce-4727-b64e-db519ecb9418 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.094241 Nov 16 16:20:18.112519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.113295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 428/782] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:18 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:18.113842 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.114457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.273108 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:18.282178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4fb86cbd-33a4-4f65-8ada-ff2788c2b3bf tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1514 microversion: 2.1 time: 0.186371 Nov 16 16:20:18.282765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 355/783] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:18 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:18.618105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:18.618722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:18.626149 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.626695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.627478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.627988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.655068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:20:18.744872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-41031c77-6ba5-418b-9a50-e70d9c8d7ea7 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 204 len: 0 microversion: 2.1 time: 0.130595 Nov 16 16:20:18.745671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 429/784] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:20:18 2021] DELETE /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:20:18.759388 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:18.760680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:18.771319 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.771770 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.772653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:18.773168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:18.922668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:18.930405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-068641c5-7833-4597-ac59-3f0f5c09e920 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1507 microversion: 2.1 time: 0.179916 Nov 16 16:20:18.931004 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 356/785] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:18 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:19.127155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2da147fd-78d8-4cf0-b1d2-198ce4c52f95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:19.128397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2da147fd-78d8-4cf0-b1d2-198ce4c52f95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:19.138319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2da147fd-78d8-4cf0-b1d2-198ce4c52f95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:19.139097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2da147fd-78d8-4cf0-b1d2-198ce4c52f95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:19.139866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2da147fd-78d8-4cf0-b1d2-198ce4c52f95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:19.140292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2da147fd-78d8-4cf0-b1d2-198ce4c52f95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:19.240840 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2da147fd-78d8-4cf0-b1d2-198ce4c52f95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.118940 Nov 16 16:20:19.241775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 430/786] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:19 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:19.298792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:19.299540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:19.306339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:19.306929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:19.308249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:19.308734 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:19.456727 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:19.464418 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-544b5726-a664-4e9b-8b8b-1f63c7f3627d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1514 microversion: 2.1 time: 0.169436 Nov 16 16:20:19.464977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 357/787] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:19 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:19.948580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:19.949266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:19.957025 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:19.957475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:19.958242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:19.958793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:20.107342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:20.115867 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-039fa1f9-7979-4e64-a7f6-8f5a1fdf3d98 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1507 microversion: 2.1 time: 0.171405 Nov 16 16:20:20.116444 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 431/788] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:19 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:20.253371 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f5636c4c-f5f5-4442-89d1-d79eec3cb26f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:20.254385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f5636c4c-f5f5-4442-89d1-d79eec3cb26f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:20.261275 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5636c4c-f5f5-4442-89d1-d79eec3cb26f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:20.261718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5636c4c-f5f5-4442-89d1-d79eec3cb26f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:20.262501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5636c4c-f5f5-4442-89d1-d79eec3cb26f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:20.262926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f5636c4c-f5f5-4442-89d1-d79eec3cb26f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:20.367453 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f5636c4c-f5f5-4442-89d1-d79eec3cb26f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.117497 Nov 16 16:20:20.368102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 358/789] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:20 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:20.481866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:20.482573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:20.489783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:20.490249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:20.491342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:20.491778 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:20.640252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:20.648684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b2c44d3a-2399-4816-8286-4e4bf27a2ec6 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1514 microversion: 2.1 time: 0.171213 Nov 16 16:20:20.649237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 432/790] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:20 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:21.134299 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:21.135068 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:21.143019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:21.143498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:21.144257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:21.144748 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:21.308444 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:21.319937 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2f87ca59-c4e5-492b-a710-02859b2f5f0a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1507 microversion: 2.1 time: 0.189419 Nov 16 16:20:21.324141 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 359/791] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:21 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:21.380480 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ff826510-ec07-4230-ac51-e2ac20cc1a9d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:21.382094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ff826510-ec07-4230-ac51-e2ac20cc1a9d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:21.388652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff826510-ec07-4230-ac51-e2ac20cc1a9d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:21.389101 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff826510-ec07-4230-ac51-e2ac20cc1a9d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:21.389878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff826510-ec07-4230-ac51-e2ac20cc1a9d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:21.390305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff826510-ec07-4230-ac51-e2ac20cc1a9d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:21.463077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ff826510-ec07-4230-ac51-e2ac20cc1a9d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.086717 Nov 16 16:20:21.464397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 433/792] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:21 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:21.665726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:21.666847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:21.673948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:21.674582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:21.675597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:21.676192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:21.749001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:21.758574 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-30262e75-267e-4078-938d-5b3cb77b49b3 req-8a17f375-e33f-45e9-a3c4-52ef597925f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d943e03-7c19-4b32-9128-be9653041cf1", "name": "network-vif-deleted", "tag": "24f92f52-cc75-4491-8558-bf35946f36d3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:21.759951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b68a3846-8de2-432e-9797-749813fa07c9 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 200 len: 1472 microversion: 2.1 time: 0.097872 Nov 16 16:20:21.760569 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:21.760569 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:20:21.760980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 360/793] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:21 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 1472 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:21.780151 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-30262e75-267e-4078-938d-5b3cb77b49b3 req-8a17f375-e33f-45e9-a3c4-52ef597925f8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:21.781330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-30262e75-267e-4078-938d-5b3cb77b49b3 req-8a17f375-e33f-45e9-a3c4-52ef597925f8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:21.796950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-30262e75-267e-4078-938d-5b3cb77b49b3 req-8a17f375-e33f-45e9-a3c4-52ef597925f8 service nova] Creating event network-vif-deleted:24f92f52-cc75-4491-8558-bf35946f36d3 for instance 6d943e03-7c19-4b32-9128-be9653041cf1 on hv-cinder-78776 Nov 16 16:20:21.802947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-30262e75-267e-4078-938d-5b3cb77b49b3 req-8a17f375-e33f-45e9-a3c4-52ef597925f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048081 Nov 16 16:20:21.804196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 434/794] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:20:22.341638 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:22.343186 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:22.350137 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:22.350607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:22.351378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:22.351798 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:22.479186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-66b4b1ba-a300-4201-b690-7880d29c7d21 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:22.481138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-66b4b1ba-a300-4201-b690-7880d29c7d21 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:22.487586 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66b4b1ba-a300-4201-b690-7880d29c7d21 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:22.488198 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66b4b1ba-a300-4201-b690-7880d29c7d21 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:22.489206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66b4b1ba-a300-4201-b690-7880d29c7d21 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:22.489775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66b4b1ba-a300-4201-b690-7880d29c7d21 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:22.526079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:22.540867 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-db31c334-649b-44f3-879e-b41be113abce tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1507 microversion: 2.1 time: 0.205077 Nov 16 16:20:22.541698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 361/795] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:22 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:22.628175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-66b4b1ba-a300-4201-b690-7880d29c7d21 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.156482 Nov 16 16:20:22.629121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 435/796] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:22 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:20:22.777324 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:22.777994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 6d943e03-7c19-4b32-9128-be9653041cf1] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:22.784373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:22.784984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:22.785621 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:22.786089 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:22.800420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] HTTP exception thrown: Instance 6d943e03-7c19-4b32-9128-be9653041cf1 could not be found. Nov 16 16:20:22.801016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Returning 404 to user: Instance 6d943e03-7c19-4b32-9128-be9653041cf1 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:20:22.801861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-be97f748-866c-484f-b80b-d84a28dc2bad tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1" status: 404 len: 111 microversion: 2.1 time: 0.028379 Nov 16 16:20:22.802483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 362/797] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:22 2021] GET /compute/v2.1/servers/6d943e03-7c19-4b32-9128-be9653041cf1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:20:23.559224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:23.559883 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:23.567650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:23.568094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:23.568872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:23.569298 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:23.639250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:23.640775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-59b3cedc-315d-4cae-a06c-31e73c5d308c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:23.641701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-59b3cedc-315d-4cae-a06c-31e73c5d308c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:23.648959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59b3cedc-315d-4cae-a06c-31e73c5d308c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:23.649405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59b3cedc-315d-4cae-a06c-31e73c5d308c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:23.650191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59b3cedc-315d-4cae-a06c-31e73c5d308c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:23.650646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-59b3cedc-315d-4cae-a06c-31e73c5d308c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:23.650920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6223d4a3-5aa2-46f6-a60a-c1b64d771d9b tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 200 len: 1465 microversion: 2.1 time: 0.096073 Nov 16 16:20:23.654517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 436/798] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:23 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 1465 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:23.818248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-a1a2e7f6-cf9f-4f2f-9e73-d8410fbdc380 req-2722eb10-b8c7-4489-814b-3291d0df9435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c10d18-b689-4550-a354-e0b0594039b3", "name": "network-vif-deleted", "tag": "d959c80e-06c3-41aa-8b1d-d2db534f4407"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:23.819849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:23.819849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:20:23.827480 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a1a2e7f6-cf9f-4f2f-9e73-d8410fbdc380 req-2722eb10-b8c7-4489-814b-3291d0df9435 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:23.827911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a1a2e7f6-cf9f-4f2f-9e73-d8410fbdc380 req-2722eb10-b8c7-4489-814b-3291d0df9435 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:23.840300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-a1a2e7f6-cf9f-4f2f-9e73-d8410fbdc380 req-2722eb10-b8c7-4489-814b-3291d0df9435 service nova] Creating event network-vif-deleted:d959c80e-06c3-41aa-8b1d-d2db534f4407 for instance b0c10d18-b689-4550-a354-e0b0594039b3 on hv-cinder-78776 Nov 16 16:20:23.845257 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-a1a2e7f6-cf9f-4f2f-9e73-d8410fbdc380 req-2722eb10-b8c7-4489-814b-3291d0df9435 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030695 Nov 16 16:20:23.845829 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 437/799] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:20:23.944738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:23.945506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:23.948238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-59b3cedc-315d-4cae-a06c-31e73c5d308c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.311020 Nov 16 16:20:23.949152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 363/800] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:23 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:20:23.952951 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:23.953663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:23.954644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:23.955081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:23.980775 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:20:24.063358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-17fda410-3a6e-46c5-bc5b-20d9673ec6f2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 204 len: 0 microversion: 2.1 time: 0.124041 Nov 16 16:20:24.064445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 438/801] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:20:23 2021] DELETE /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:20:24.074975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:24.075679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:24.082785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.083230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.084009 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.084440 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.223467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:24.233201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e858b67c-6335-46ae-9cd8-6fe3dc776b4d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.163864 Nov 16 16:20:24.233829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 364/802] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:24 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:24.669040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:24.669725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: b0c10d18-b689-4550-a354-e0b0594039b3] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:24.676696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.677145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.677915 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.678344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.693125 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] HTTP exception thrown: Instance b0c10d18-b689-4550-a354-e0b0594039b3 could not be found. Nov 16 16:20:24.693717 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Returning 404 to user: Instance b0c10d18-b689-4550-a354-e0b0594039b3 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:20:24.694615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2cfa612a-5c82-49fb-9332-e53b5fe73f15 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3" status: 404 len: 111 microversion: 2.1 time: 0.029612 Nov 16 16:20:24.695172 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 439/803] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:24 2021] GET /compute/v2.1/servers/b0c10d18-b689-4550-a354-e0b0594039b3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:20:24.703511 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:24.704056 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:24.711476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.711931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.712789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.713253 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.741775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:20:24.837323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9eb20b31-1903-4f45-ac3e-c173a80863ed tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 204 len: 0 microversion: 2.1 time: 0.137098 Nov 16 16:20:24.837908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 365/804] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:20:24 2021] DELETE /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:20:24.846042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:24.846718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:24.852741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.853188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.853968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.854422 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.971126 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d066ad45-47e0-45a1-9c85-ef35e338dcd9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:24.972199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d066ad45-47e0-45a1-9c85-ef35e338dcd9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:24.979145 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d066ad45-47e0-45a1-9c85-ef35e338dcd9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.979596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d066ad45-47e0-45a1-9c85-ef35e338dcd9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.980390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d066ad45-47e0-45a1-9c85-ef35e338dcd9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:24.980820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d066ad45-47e0-45a1-9c85-ef35e338dcd9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:24.992550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:24.999908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-46df886c-a151-47b5-aff9-1def45109ee8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.157631 Nov 16 16:20:25.000484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 440/805] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:24 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:25.076267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d066ad45-47e0-45a1-9c85-ef35e338dcd9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.117200 Nov 16 16:20:25.077270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 366/806] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:24 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:25.251929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:25.252699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:25.260265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:25.261165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:25.262092 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:25.262790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:25.404378 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:25.412985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c542446c-3d8e-4281-b05a-c5b984e52529 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.164661 Nov 16 16:20:25.413535 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 441/807] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:25 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:26.019528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:26.020249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:26.027900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:26.028341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:26.029289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:26.029724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:26.089554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b01e7a37-5887-492e-82ce-8612d7b4d0d1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:26.090585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b01e7a37-5887-492e-82ce-8612d7b4d0d1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:26.097186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01e7a37-5887-492e-82ce-8612d7b4d0d1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:26.097646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01e7a37-5887-492e-82ce-8612d7b4d0d1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:26.098478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01e7a37-5887-492e-82ce-8612d7b4d0d1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:26.098916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01e7a37-5887-492e-82ce-8612d7b4d0d1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:26.173672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:26.182281 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ee57b1f4-a0f7-4116-b3be-71b7386009b8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.168023 Nov 16 16:20:26.182906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 367/808] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:26 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:26.257087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b01e7a37-5887-492e-82ce-8612d7b4d0d1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.170857 Nov 16 16:20:26.257988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 442/809] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:26 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:26.338513 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1956036773", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-157657213", "security_groups": [{"name": "tempest-secgroup-smoke-1834145156"}], "networks": [{"uuid": "cc31df65-f7ab-4de1-b99d-e932afa7cf74"}], "block_device_mapping_v2": [{"uuid": "0dfa702d-9571-4c29-ae95-0a0ba7689e9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:26.430036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:26.430938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:26.437950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:26.438411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:26.439209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:26.439640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:26.462221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] validate_networks() for [('cc31df65-f7ab-4de1-b99d-e932afa7cf74', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:20:26.672589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:26.680776 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ecfe434f-ad72-4031-887a-368a9c1b18c0 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.254851 Nov 16 16:20:26.681343 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 443/810] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:26 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:27.008913 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:20:27.009358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:20:27.009832 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:20:27.010239 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:20:27.010689 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:20:27.021310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.021989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.022641 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.023062 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.040379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Getting quotas for project 9e9e25e747f14010be9908f8ccb0712f. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:20:27.044352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Getting quotas for user 9ecde32d12664c48a8cff7bf839eb505 and project 9e9e25e747f14010be9908f8ccb0712f. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:20:27.102065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:20:27.104489 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0dfa702d-9571-4c29-ae95-0a0ba7689e9a',volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:20:27.200621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:27.201291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:27.207693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.208484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.209345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.209802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.247274 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-32a425fe-5f02-4d41-a34f-48709c0ddaf6 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.912692 Nov 16 16:20:27.248434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 368/811] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:20:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:20:27.257964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3e85f767-7a41-41f3-bb98-d2e7fdbf8953 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:27.258614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3e85f767-7a41-41f3-bb98-d2e7fdbf8953 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:27.323076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3e85f767-7a41-41f3-bb98-d2e7fdbf8953 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:27.336219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3e85f767-7a41-41f3-bb98-d2e7fdbf8953 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1088 microversion: 2.1 time: 0.081820 Nov 16 16:20:27.347032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 369/812] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:27 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1088 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:27.352131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3809c684-78b5-4edc-9df9-034a418a421a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:27.353407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3809c684-78b5-4edc-9df9-034a418a421a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:27.359446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3809c684-78b5-4edc-9df9-034a418a421a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.359896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3809c684-78b5-4edc-9df9-034a418a421a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.360680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3809c684-78b5-4edc-9df9-034a418a421a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.361185 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3809c684-78b5-4edc-9df9-034a418a421a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.407503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:27.415571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5a8fb0d0-a6c8-4e13-96fd-e3ded218bbf8 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.219100 Nov 16 16:20:27.420533 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 444/813] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:27 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:27.697338 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:27.697938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:27.704198 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.704669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.705357 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:27.705780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:27.844069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:27.851541 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1ca0ee5a-6ea8-4cf6-8fd4-000edb6c5889 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.158136 Nov 16 16:20:27.852094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 445/814] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:27 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:28.356203 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:28.358007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:28.366934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:28.367453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:28.368248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:28.368677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:28.439264 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:28.447475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-08828d32-4a0c-4103-a29f-451b18623749 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1138 microversion: 2.1 time: 0.096515 Nov 16 16:20:28.448055 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 446/815] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:28 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:28.452353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:28.452935 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:28.458880 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:28.459344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:28.460121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:28.460552 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:28.603759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:28.611453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4eb37de6-1b59-44ea-b50c-2e862ffa152c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.162417 Nov 16 16:20:28.611926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 447/816] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:28 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:28.868145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:28.868646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:28.875138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:28.875581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:28.876365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:28.876794 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:29.014506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:29.022847 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-edb5be78-1330-490c-9e7e-d18e84625f4e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.158491 Nov 16 16:20:29.023418 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 448/817] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:28 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:29.464253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:29.464940 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:29.471657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:29.472109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:29.472886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:29.473318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:29.547994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:29.556329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-69da73b7-0d3f-4394-b451-137aab9bc564 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1138 microversion: 2.1 time: 0.095767 Nov 16 16:20:29.557040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 449/818] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:29 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:29.629051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:29.629673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:29.637241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:29.637686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:29.638519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:29.638952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:29.802979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:29.814704 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cc11bba9-f774-4476-bfcf-b7c40b0591eb tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.189241 Nov 16 16:20:29.815469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 450/819] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:29 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:30.043014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:30.043982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:30.054239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:30.054798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:30.055643 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:30.056092 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:30.206017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:30.213700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8d86d540-e23d-4d4f-86f1-10789d7a80eb tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.176970 Nov 16 16:20:30.214279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 451/820] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:30 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:30.580021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:30.581093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:30.589678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:30.590126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:30.590931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:30.591363 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:30.659918 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:30.668174 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8dd35ed6-bc6c-44cb-a625-8325e19b7e88 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1138 microversion: 2.1 time: 0.094328 Nov 16 16:20:30.668729 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 452/821] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:30 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:30.837366 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:30.837972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:30.844836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:30.845476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:30.846293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:30.846759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:30.993404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:31.003227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bce03929-f8a5-48d8-9f25-4747e306584c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.171438 Nov 16 16:20:31.003811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 453/822] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:30 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:31.232415 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:31.232779 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:31.239236 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:31.239726 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:31.240494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:31.240918 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:31.390808 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:31.399619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d09cee22-7c6c-4583-a884-a99eea1e8eb3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.171030 Nov 16 16:20:31.400363 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 454/823] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:31 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:31.688329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:31.689048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:31.697690 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:31.698137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:31.698976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:31.699412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:31.761649 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:31.770213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-08f48043-fe5a-4c29-a578-de8174b5bcef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1138 microversion: 2.1 time: 0.087532 Nov 16 16:20:31.770677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 455/824] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:31 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:32.186176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:32.186797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:32.193100 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:32.193536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:32.194290 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:32.194744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:32.338254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:32.345832 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-87bb2f3c-545b-47c7-b07e-9cbfe441383f tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.326803 Nov 16 16:20:32.346402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 456/825] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:32 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:32.417590 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:32.418185 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:32.425067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:32.425489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:32.426258 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:32.426722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:32.566307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:32.574673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d3ed8d0c-5634-48c3-a68e-b78bf7992efc tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.161332 Nov 16 16:20:32.575227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 457/826] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:32 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:32.787469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:32.788200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:32.795070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:32.795513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:32.796288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:32.796714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:32.857800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:32.865465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4bcb10d6-7478-4bdd-8372-2b64bc1dbcc2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1138 microversion: 2.1 time: 0.081682 Nov 16 16:20:32.866021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 458/827] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:32 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:33.362950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:33.363579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:33.370752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:33.371237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:33.372010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:33.372467 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:33.513174 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:33.521598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e236c92f-8e32-4278-9de5-6144486a55b0 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.162315 Nov 16 16:20:33.522351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 459/828] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:33 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:33.595001 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:33.595802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:33.605276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:33.605752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:33.607044 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:33.607704 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:33.750895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:33.758661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2154bd58-9183-4e5c-83a4-8ccd770b393e tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1515 microversion: 2.1 time: 0.169878 Nov 16 16:20:33.759223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 460/829] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:33 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:33.884634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:33.885444 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:33.894299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:33.894937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:33.895972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:33.896583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:33.956898 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:33.964469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2f01e821-13f8-4b00-a630-90dc6f903166 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1186 microversion: 2.1 time: 0.085122 Nov 16 16:20:33.965054 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 461/830] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:33 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:34.380045 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3809c684-78b5-4edc-9df9-034a418a421a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 7.031327 Nov 16 16:20:34.380659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 370/831] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:27 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 7033 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:34.538959 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:34.539648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:34.545905 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:34.546417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:34.547206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:34.547659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:34.709620 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:34.728867 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6dd496c1-850d-402e-a0f7-04a1e376e34c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.193662 Nov 16 16:20:34.734826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 462/832] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:34 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:34.776496 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:34.777597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:34.790990 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:34.791816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:34.792837 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:34.796257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:34.888255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:34.900289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7bab7701-8a94-44b4-bf31-94c4de19b2e2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 200 len: 1473 microversion: 2.1 time: 0.126506 Nov 16 16:20:34.900974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 371/833] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:34 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 1473 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:34.937375 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-15b5796d-6fb4-429c-9f2a-f3bc12e999cb req-0d68fe83-d3cb-4644-af2a-8c96efb8e67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45fbcda0-44c4-45be-9b1f-96d4eceda3d8", "name": "network-vif-deleted", "tag": "abdeea90-028a-4b7a-9617-51b8c519f3d5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:34.939067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:34.939067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:20:34.947334 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-15b5796d-6fb4-429c-9f2a-f3bc12e999cb req-0d68fe83-d3cb-4644-af2a-8c96efb8e67c service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:34.948274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-15b5796d-6fb4-429c-9f2a-f3bc12e999cb req-0d68fe83-d3cb-4644-af2a-8c96efb8e67c service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:34.969747 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-15b5796d-6fb4-429c-9f2a-f3bc12e999cb req-0d68fe83-d3cb-4644-af2a-8c96efb8e67c service nova] Creating event network-vif-deleted:abdeea90-028a-4b7a-9617-51b8c519f3d5 for instance 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 on hv-cinder-78776 Nov 16 16:20:34.981250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:34.981962 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:34.988939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:34.990994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-15b5796d-6fb4-429c-9f2a-f3bc12e999cb req-0d68fe83-d3cb-4644-af2a-8c96efb8e67c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057437 Nov 16 16:20:34.992017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 463/834] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:20:34.992918 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:34.994789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:34.995573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.119546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:35.138821 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8420eb5b-27d6-4a93-97c7-9d277b545e1f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1204 microversion: 2.1 time: 0.160969 Nov 16 16:20:35.142203 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 372/835] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:34 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1204 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:35.513538 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9d2d0725-b8f4-4178-b3fd-3e9c0fb97375 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:35.514607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9d2d0725-b8f4-4178-b3fd-3e9c0fb97375 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:35.521618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9d2d0725-b8f4-4178-b3fd-3e9c0fb97375 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.522838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9d2d0725-b8f4-4178-b3fd-3e9c0fb97375 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.523636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9d2d0725-b8f4-4178-b3fd-3e9c0fb97375 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.524059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9d2d0725-b8f4-4178-b3fd-3e9c0fb97375 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.606682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9d2d0725-b8f4-4178-b3fd-3e9c0fb97375 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.217683 Nov 16 16:20:35.615382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 464/836] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:35 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:35.751517 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:35.752266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:35.759741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.760191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.761003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.761433 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.917763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:35.918514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 45fbcda0-44c4-45be-9b1f-96d4eceda3d8] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:35.925790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.926206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.927259 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.927693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.943273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] HTTP exception thrown: Instance 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 could not be found. Nov 16 16:20:35.943980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Returning 404 to user: Instance 45fbcda0-44c4-45be-9b1f-96d4eceda3d8 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:20:35.944687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6f4c9f95-1d66-4be5-9d06-c59bf87df693 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8" status: 404 len: 111 microversion: 2.1 time: 0.031429 Nov 16 16:20:35.946508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 465/837] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:35 2021] GET /compute/v2.1/servers/45fbcda0-44c4-45be-9b1f-96d4eceda3d8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:20:35.953166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:35.953658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:35.960411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.960979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.962408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:35.962869 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:35.988659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:20:36.020256 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:36.029383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a759cae4-555c-4328-a00b-4ddc03dd1cbd tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.281695 Nov 16 16:20:36.030357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 373/838] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:35 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:36.067937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4cb3b284-0ec3-4bf7-b1c4-4275ea951d0d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 204 len: 0 microversion: 2.1 time: 0.118122 Nov 16 16:20:36.068835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 466/839] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:20:35 2021] DELETE /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:20:36.076827 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:36.077673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:36.083781 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:36.084301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:36.085165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:36.085777 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:36.159234 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:36.159903 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:36.166190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:36.166861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:36.167949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:36.168300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:36.576075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:36.583940 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fcff4180-2938-4570-8d86-d8da3004fcb2 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1514 microversion: 2.1 time: 0.510799 Nov 16 16:20:36.584530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 374/840] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:36 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1514 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:36.626246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3595bc42-a184-4721-b9de-e2a24311cd54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:36.630901 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3595bc42-a184-4721-b9de-e2a24311cd54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:36.637125 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3595bc42-a184-4721-b9de-e2a24311cd54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:36.637552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3595bc42-a184-4721-b9de-e2a24311cd54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:36.638341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3595bc42-a184-4721-b9de-e2a24311cd54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:36.638791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3595bc42-a184-4721-b9de-e2a24311cd54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:36.697536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:36.707442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2126744d-43bb-4302-a853-73cb01840f63 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1272 microversion: 2.1 time: 0.552075 Nov 16 16:20:36.707935 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 467/841] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:36 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1272 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:36.845441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-8f8c2b3b-e71c-4037-97b2-42e983a4efd6 req-99f10f6f-d25e-4d93-b0f8-0b360363ecd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78eb3995-5e51-438c-932d-e5740e28c38e", "tag": "e73fa700-ec5c-41fb-b99b-cd813ff621b5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:36.851705 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:36.851705 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:20:36.859269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-8f8c2b3b-e71c-4037-97b2-42e983a4efd6 req-99f10f6f-d25e-4d93-b0f8-0b360363ecd8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:36.859708 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-8f8c2b3b-e71c-4037-97b2-42e983a4efd6 req-99f10f6f-d25e-4d93-b0f8-0b360363ecd8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:36.872828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-8f8c2b3b-e71c-4037-97b2-42e983a4efd6 req-99f10f6f-d25e-4d93-b0f8-0b360363ecd8 service nova] Creating event network-changed:e73fa700-ec5c-41fb-b99b-cd813ff621b5 for instance 78eb3995-5e51-438c-932d-e5740e28c38e on hv-cinder-78776 Nov 16 16:20:36.877625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-8f8c2b3b-e71c-4037-97b2-42e983a4efd6 req-99f10f6f-d25e-4d93-b0f8-0b360363ecd8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036185 Nov 16 16:20:36.878231 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 468/842] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:37.048990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:37.049731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:37.056747 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:37.057194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:37.057978 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:37.058408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:37.204388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:37.216554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-361897a9-719c-4090-b490-e2362c94ae8a tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.171729 Nov 16 16:20:37.217287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 469/843] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:37 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:37.601107 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:37.601900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:37.608668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:37.609123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:37.610031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:37.610539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:37.754581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:37.763724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d1a9219b-23d9-4692-b72b-0b6af8b0ed17 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1514 microversion: 2.1 time: 0.166300 Nov 16 16:20:37.764297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 470/844] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:37 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:37.769004 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:37.769611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:37.775781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:37.776231 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:37.776992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:37.777419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:37.926938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:37.938014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e331aba7-1330-459c-83ff-1bd976fa2435 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1272 microversion: 2.1 time: 0.172489 Nov 16 16:20:37.938748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 471/845] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:37 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:38.241244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:38.242501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:38.249248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:38.249703 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:38.250528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:38.250963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:38.397579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:38.406514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e7cca3bd-f70b-4012-bd5e-b83719847995 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.171978 Nov 16 16:20:38.407070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 472/846] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:38 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:38.781158 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:38.781766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:38.788317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:38.788849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:38.789630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:38.790062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:38.941445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:38.951531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-166a53be-a4fa-48e6-aa22-09ee1908324d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1514 microversion: 2.1 time: 0.174178 Nov 16 16:20:38.952184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 473/847] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:38 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:38.956610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:38.957193 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:38.963307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:38.963747 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:38.964502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:38.964925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:39.110072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:39.118513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-de59b44a-8314-456d-afec-56c0131f251b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1272 microversion: 2.1 time: 0.165272 Nov 16 16:20:39.119090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 474/848] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:38 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:39.427955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:39.429017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:39.440794 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:39.441546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:39.443141 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:39.443865 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:39.592224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:39.605127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7bd27b0a-76bd-4504-92fc-5fdf4e088f74 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.183465 Nov 16 16:20:39.605927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 475/849] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:39 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:39.972430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:39.973468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:39.981178 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:39.981617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:39.982400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:39.982831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:40.137869 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:40.145640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0c54de49-641a-4783-87ed-4fb5999b0d94 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1514 microversion: 2.1 time: 0.180110 Nov 16 16:20:40.146202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 476/850] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:39 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:40.150765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:40.151367 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:40.156882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:40.157329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:40.158093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:40.158601 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:40.304043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:40.311938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4d10b225-e65f-44c4-b4bf-eb5535c150a4 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1272 microversion: 2.1 time: 0.164704 Nov 16 16:20:40.312649 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 477/851] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:40 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:40.630398 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:40.631499 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:40.643140 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:40.643869 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:40.645203 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:40.645911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:40.784670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:40.792780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-683a4ba3-25cc-4374-841d-4243d8f17afa tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.168613 Nov 16 16:20:40.793339 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 478/852] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:40 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:41.167132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:41.168133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:41.178842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:41.179666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:41.180469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:41.180896 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:41.330223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:41.340721 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ea690e97-1269-4e40-b523-67a6da0df22b tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1514 microversion: 2.1 time: 0.179903 Nov 16 16:20:41.341295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 479/853] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:41 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:41.345896 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:41.346638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:41.353473 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:41.353973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:41.354928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:41.355373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:41.401512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3595bc42-a184-4721-b9de-e2a24311cd54 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 4.779024 Nov 16 16:20:41.402876 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 375/854] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:36 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 4781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:41.521932 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:41.530469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-506de9e6-f493-4d44-9004-4b6ee6188bdc tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1272 microversion: 2.1 time: 0.188110 Nov 16 16:20:41.531428 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 480/855] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:41 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:41.810240 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:41.811250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:41.819344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:41.819959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:41.821013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:41.821443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:41.967596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:41.976039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-43af6835-264e-4e22-bd20-f127b8de3855 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.170316 Nov 16 16:20:41.976750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 376/856] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:41 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:42.357628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:42.358215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:42.365221 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:42.365657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:42.366427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:42.366884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:42.417184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ce2e1399-c178-4cd2-9210-c5c4b635cb93 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:42.418782 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ce2e1399-c178-4cd2-9210-c5c4b635cb93 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:42.425258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ce2e1399-c178-4cd2-9210-c5c4b635cb93 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:42.426093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ce2e1399-c178-4cd2-9210-c5c4b635cb93 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:42.426950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ce2e1399-c178-4cd2-9210-c5c4b635cb93 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:42.427473 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ce2e1399-c178-4cd2-9210-c5c4b635cb93 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:42.518713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ce2e1399-c178-4cd2-9210-c5c4b635cb93 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.108649 Nov 16 16:20:42.519604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 377/857] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:42 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:42.523365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:42.529614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f6c14dcb-97ec-4bce-b4ba-f2174258aae8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1514 microversion: 2.1 time: 0.176240 Nov 16 16:20:42.530168 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 481/858] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:42 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:42.548839 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:42.549528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:42.556558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:42.557014 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:42.557792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:42.558221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:42.695352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:42.707319 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6a31a36e-713f-4065-a2b0-7955667ec2df tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1272 microversion: 2.1 time: 0.162177 Nov 16 16:20:42.708063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 378/859] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:42 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:42.993904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:42.994532 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:43.000669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.001108 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.001875 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.002306 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.145737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:43.156346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a3fe652c-cac2-4bdd-bf6a-80fb3d4e0195 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.166292 Nov 16 16:20:43.157026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 482/860] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:42 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:43.532033 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c849999c-3ee4-4692-b135-ad22f3f7d6a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:43.533132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c849999c-3ee4-4692-b135-ad22f3f7d6a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:43.541454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c849999c-3ee4-4692-b135-ad22f3f7d6a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.541454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c849999c-3ee4-4692-b135-ad22f3f7d6a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.541454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c849999c-3ee4-4692-b135-ad22f3f7d6a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.542050 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c849999c-3ee4-4692-b135-ad22f3f7d6a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.546546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:43.548039 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:43.554466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.554987 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.556054 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.556654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.693312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:43.703206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4a28edc4-3a9e-4a9b-8cbb-2f1840b5feb7 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1514 microversion: 2.1 time: 0.160268 Nov 16 16:20:43.703774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 483/861] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:43 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:43.726141 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:43.726772 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:43.733121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.733551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.734325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:43.734803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:43.872948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:43.881031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1966683d-342a-4e7d-a17e-6dfede51c653 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.158369 Nov 16 16:20:43.881814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 484/862] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:43 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:43.882879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c849999c-3ee4-4692-b135-ad22f3f7d6a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.354586 Nov 16 16:20:43.883484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 379/863] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:43 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:44.174866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:44.175388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:44.182016 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.182484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.183332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.183831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.326369 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:44.334157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-beda0017-60c7-4916-803a-db8da66bef61 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1522 microversion: 2.1 time: 0.163207 Nov 16 16:20:44.334748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 485/864] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:44 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:44.721223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:44.722239 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:44.730092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.730923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.731831 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.732615 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.849358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:44.852069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-e8fa6352-f054-45ae-b1cb-84b251048f57 req-81917049-c656-4515-b0d2-90a04579b5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "420506b0-61e6-4805-9ad2-8bff0d02a492", "name": "network-vif-deleted", "tag": "c3148a2d-2ddf-47ae-bb9f-68eff80c86c5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:44.854246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:44.854246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:20:44.858842 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-39ec8093-faa5-4450-a779-7d2c8aaa24a3 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 200 len: 1472 microversion: 2.1 time: 0.141629 Nov 16 16:20:44.860050 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 380/865] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:44 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 1472 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:44.867256 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e8fa6352-f054-45ae-b1cb-84b251048f57 req-81917049-c656-4515-b0d2-90a04579b5e6 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.867922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e8fa6352-f054-45ae-b1cb-84b251048f57 req-81917049-c656-4515-b0d2-90a04579b5e6 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.882678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-e8fa6352-f054-45ae-b1cb-84b251048f57 req-81917049-c656-4515-b0d2-90a04579b5e6 service nova] Creating event network-vif-deleted:c3148a2d-2ddf-47ae-bb9f-68eff80c86c5 for instance 420506b0-61e6-4805-9ad2-8bff0d02a492 on hv-cinder-78776 Nov 16 16:20:44.887854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-e8fa6352-f054-45ae-b1cb-84b251048f57 req-81917049-c656-4515-b0d2-90a04579b5e6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124710 Nov 16 16:20:44.888592 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 486/866] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:20:44.897529 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-07264065-4fd5-4521-863b-680e81eb84b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:44.898491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-07264065-4fd5-4521-863b-680e81eb84b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:44.905268 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:44.905549 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07264065-4fd5-4521-863b-680e81eb84b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.906003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07264065-4fd5-4521-863b-680e81eb84b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.906576 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:44.906831 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07264065-4fd5-4521-863b-680e81eb84b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.907268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-07264065-4fd5-4521-863b-680e81eb84b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.917316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.919688 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:44.920814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:44.921328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.010765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-07264065-4fd5-4521-863b-680e81eb84b6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.118609 Nov 16 16:20:45.011568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 381/867] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:44 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:45.148446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:45.156350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0b398987-99e7-40eb-aff1-60a6cd48e6e9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.256402 Nov 16 16:20:45.156924 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 487/868] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:44 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:45.323225 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-35317506-b0c6-4fe6-961f-83c59278167a req-0890c954-503b-44d1-91fa-0ac9422490ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca96c22d-d0ae-48e0-9f0f-fa02d0324fec", "name": "network-vif-deleted", "tag": "85446dc9-e1a3-4e4d-90db-94d908195108"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:45.325061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:45.325061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:20:45.334447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-35317506-b0c6-4fe6-961f-83c59278167a req-0890c954-503b-44d1-91fa-0ac9422490ad service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.334891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-35317506-b0c6-4fe6-961f-83c59278167a req-0890c954-503b-44d1-91fa-0ac9422490ad service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.345376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-35317506-b0c6-4fe6-961f-83c59278167a req-0890c954-503b-44d1-91fa-0ac9422490ad service nova] Creating event network-vif-deleted:85446dc9-e1a3-4e4d-90db-94d908195108 for instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec on hv-cinder-78776 Nov 16 16:20:45.350286 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-35317506-b0c6-4fe6-961f-83c59278167a req-0890c954-503b-44d1-91fa-0ac9422490ad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096522 Nov 16 16:20:45.350914 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 382/869] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:45.351686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:45.352321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:45.358363 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.358829 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.359612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.360035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.391067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.391524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.391962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lazy-loading 'fault' on Instance uuid ca96c22d-d0ae-48e0-9f0f-fa02d0324fec {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:20:45.436135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a93b78bf18b42bc929d716d21793438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '083b4d0792f3466b9c3e1fbc219e5b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:45.443785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cc88d1de-90d9-4bb1-8def-1a87f93a5b92 tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 200 len: 1312 microversion: 2.1 time: 0.095689 Nov 16 16:20:45.444401 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 488/870] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:45 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:45.803224 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:45.803748 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:45.810095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.810541 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.811356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.811781 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.878099 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:45.878770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: 420506b0-61e6-4805-9ad2-8bff0d02a492] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:45.884990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.885436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.886260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:45.886733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:45.902665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lazy-loading 'services' on Instance uuid 1bec3e44-7feb-44da-a4d2-6655f7643bf0 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:20:45.904313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] HTTP exception thrown: Instance 420506b0-61e6-4805-9ad2-8bff0d02a492 could not be found. Nov 16 16:20:45.904914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Returning 404 to user: Instance 420506b0-61e6-4805-9ad2-8bff0d02a492 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:20:45.905733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6eb04634-33f0-4ef2-ab8c-0f86d075097f tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492" status: 404 len: 111 microversion: 2.1 time: 0.032440 Nov 16 16:20:45.906275 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 489/871] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:45 2021] GET /compute/v2.1/servers/420506b0-61e6-4805-9ad2-8bff0d02a492 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:20:45.977538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-03e0d63f-2232-40f7-98a3-0dc0eef85994 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0/os-volume_attachments/af533b38-1186-4503-bcf2-7b60fee2203d" status: 202 len: 0 microversion: 2.1 time: 0.178821 Nov 16 16:20:45.978277 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 383/872] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:20:45 2021] DELETE /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0/os-volume_attachments/af533b38-1186-4503-bcf2-7b60fee2203d => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:20:46.029327 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8d1f1cf5-9d42-4280-a126-74d73d37950f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:46.030313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8d1f1cf5-9d42-4280-a126-74d73d37950f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:46.037748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d1f1cf5-9d42-4280-a126-74d73d37950f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:46.038201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d1f1cf5-9d42-4280-a126-74d73d37950f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:46.039204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d1f1cf5-9d42-4280-a126-74d73d37950f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:46.039634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8d1f1cf5-9d42-4280-a126-74d73d37950f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:46.142656 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8d1f1cf5-9d42-4280-a126-74d73d37950f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.116644 Nov 16 16:20:46.143417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 490/873] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:46 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:46.177047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:46.177980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:46.187835 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:46.188443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:46.189570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:46.190201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:46.343500 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:46.354532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4624c527-0a7d-483f-883e-1fe1c2b9bccf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.183793 Nov 16 16:20:46.355159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 384/874] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:46 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:46.462622 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:46.463407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] [instance: ca96c22d-d0ae-48e0-9f0f-fa02d0324fec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:46.474212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:46.474691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:46.475483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:46.475944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:46.492999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] HTTP exception thrown: Instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec could not be found. Nov 16 16:20:46.493589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] Returning 404 to user: Instance ca96c22d-d0ae-48e0-9f0f-fa02d0324fec could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:20:46.494429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c1559da5-6b16-4b93-bdee-d050e952880c tempest-ServerRescueNegativeTestJSON-2112049364 tempest-ServerRescueNegativeTestJSON-2112049364-project] 10.222.0.61 "GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec" status: 404 len: 111 microversion: 2.1 time: 0.036334 Nov 16 16:20:46.494968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 491/875] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:46 2021] GET /compute/v2.1/servers/ca96c22d-d0ae-48e0-9f0f-fa02d0324fec => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:20:47.045194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:47.046419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:47.053606 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.054061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.054891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.055314 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.096965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:20:47.127713 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:47.128356 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:47.135044 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.135498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.136763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.137215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.166746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:20:47.193612 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c56f748a-5ea1-4614-ba7d-af1148cea4f5 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 204 len: 0 microversion: 2.1 time: 0.151562 Nov 16 16:20:47.194680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 385/876] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:20:47 2021] DELETE /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:20:47.201271 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-533145d2-1303-4f95-b296-adb4ff611bba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:47.202668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-533145d2-1303-4f95-b296-adb4ff611bba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:47.210007 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-533145d2-1303-4f95-b296-adb4ff611bba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.213225 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-533145d2-1303-4f95-b296-adb4ff611bba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.215019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-533145d2-1303-4f95-b296-adb4ff611bba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.215554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-533145d2-1303-4f95-b296-adb4ff611bba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.264200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2681aa8f-311f-41e3-b8de-d3af05110934 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 204 len: 0 microversion: 2.1 time: 0.140137 Nov 16 16:20:47.265039 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 492/877] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:20:47 2021] DELETE /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:20:47.271065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:47.271773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:47.278327 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.278989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.279803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.280241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.314347 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-533145d2-1303-4f95-b296-adb4ff611bba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.117857 Nov 16 16:20:47.315383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 386/878] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:47 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:47.321114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:47.321829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:47.329193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.329676 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.330482 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.330913 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.637469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:47.645922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c57a5a26-ee8a-41c2-b8dd-c27ab019e96d tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1514 microversion: 2.1 time: 0.379471 Nov 16 16:20:47.656045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 493/879] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:47 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1514 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:47.656045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:47.656045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:47.657864 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.658314 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.659132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:47.659571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:47.671261 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:47.679649 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dc3c1503-e6d7-4b77-b971-e5f6315622c5 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1513 microversion: 2.1 time: 0.362523 Nov 16 16:20:47.680213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 387/880] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:47 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1513 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:47.869854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:47.878583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-47275549-52c1-4eb4-afbb-5f1b1ae4fd5b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.230560 Nov 16 16:20:47.879232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 494/881] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:47 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:48.327938 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-96160a87-27fe-403b-b1ec-f6ad0650d3bc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:48.328939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-96160a87-27fe-403b-b1ec-f6ad0650d3bc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:48.336565 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96160a87-27fe-403b-b1ec-f6ad0650d3bc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:48.337009 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96160a87-27fe-403b-b1ec-f6ad0650d3bc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:48.337792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96160a87-27fe-403b-b1ec-f6ad0650d3bc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:48.338230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-96160a87-27fe-403b-b1ec-f6ad0650d3bc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:48.415740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-96160a87-27fe-403b-b1ec-f6ad0650d3bc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.091620 Nov 16 16:20:48.417447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 388/882] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:48 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:48.663448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:48.664185 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:48.675941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:48.676415 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:48.677229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:48.677657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:48.699751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:48.700929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:48.711441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:48.712089 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:48.713104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:48.713756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:48.979026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:48.987325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7e30d381-75e2-4844-8e05-d08d0b9561c8 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1514 microversion: 2.1 time: 0.327409 Nov 16 16:20:48.988003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 495/883] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:48 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1514 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:48.989422 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:48.993051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:48.993737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:49.001509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:49.001936 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8acfab08-845d-48a8-9a47-e2232249e8c4 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1513 microversion: 2.1 time: 0.307266 Nov 16 16:20:49.002077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:49.002777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:49.003200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:49.003960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 389/884] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:48 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1513 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:49.299067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:49.306318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8044cec6-69c1-42ce-a338-c4c66eb2efda tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.317202 Nov 16 16:20:49.307059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 496/885] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:48 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:49.427887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1da6c65b-3db3-4a6d-8820-ef25f74466f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:49.428918 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1da6c65b-3db3-4a6d-8820-ef25f74466f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:49.435819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1da6c65b-3db3-4a6d-8820-ef25f74466f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:49.436400 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1da6c65b-3db3-4a6d-8820-ef25f74466f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:49.437246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1da6c65b-3db3-4a6d-8820-ef25f74466f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:49.437900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1da6c65b-3db3-4a6d-8820-ef25f74466f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:49.535079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1da6c65b-3db3-4a6d-8820-ef25f74466f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.110530 Nov 16 16:20:49.535667 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 390/886] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:49 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:50.004330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:50.004886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:50.011922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.015764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.023286 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.025702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.028376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:50.028376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:50.042820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.044181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.045294 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.045726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.513247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99d58fe781aa40b2abf368dcc69b1a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a29ddd96b66c433b981df5387fb540bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:50.524993 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-56438fe8-aec1-4c8d-9bb9-65c19d4d9dac tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 200 len: 1514 microversion: 2.1 time: 0.522787 Nov 16 16:20:50.527220 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 497/887] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:49 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 1514 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:50.530202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9f6fc7adb31457095b9e6cb4595390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd35ac8531424c33bb44b731249fdcde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:50.538171 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-13e5a12d-4daa-4f43-bdfd-f6850c347dc8 tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 200 len: 1513 microversion: 2.1 time: 0.519018 Nov 16 16:20:50.539801 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 391/888] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:50 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 1513 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:50.545385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-8ffdd6ea-9e9b-4478-a864-9d13abd2a098 req-bfb73269-cd11-4cb4-b0cb-84f5489ef31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bec3e44-7feb-44da-a4d2-6655f7643bf0", "name": "network-vif-deleted", "tag": "ea81c752-5dfa-4fa2-8b4d-f74a733ab1c1"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:50.547836 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:50.547836 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:20:50.550027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:50.553508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:50.565240 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8ffdd6ea-9e9b-4478-a864-9d13abd2a098 req-bfb73269-cd11-4cb4-b0cb-84f5489ef31d service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.571396 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-8ffdd6ea-9e9b-4478-a864-9d13abd2a098 req-bfb73269-cd11-4cb4-b0cb-84f5489ef31d service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.572884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.573588 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.574754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.575618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.584733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-8ffdd6ea-9e9b-4478-a864-9d13abd2a098 req-bfb73269-cd11-4cb4-b0cb-84f5489ef31d service nova] Creating event network-vif-deleted:ea81c752-5dfa-4fa2-8b4d-f74a733ab1c1 for instance 1bec3e44-7feb-44da-a4d2-6655f7643bf0 on hv-cinder-78776 Nov 16 16:20:50.592188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-8ffdd6ea-9e9b-4478-a864-9d13abd2a098 req-bfb73269-cd11-4cb4-b0cb-84f5489ef31d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050903 Nov 16 16:20:50.594969 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 392/889] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:50.601630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-781afc38-94ae-4819-b3ed-f2f6257ed83a req-ce2b1d87-d54f-467d-af79-e77b467520de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc4a1e6e-5d38-4c3e-8381-112022eb6207", "name": "network-vif-deleted", "tag": "975ed373-f034-4688-b3e3-efe810e76c1c"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:50.604209 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:20:50.604209 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:20:50.612707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-781afc38-94ae-4819-b3ed-f2f6257ed83a req-ce2b1d87-d54f-467d-af79-e77b467520de service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.614819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-781afc38-94ae-4819-b3ed-f2f6257ed83a req-ce2b1d87-d54f-467d-af79-e77b467520de service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.638120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-781afc38-94ae-4819-b3ed-f2f6257ed83a req-ce2b1d87-d54f-467d-af79-e77b467520de service nova] Creating event network-vif-deleted:975ed373-f034-4688-b3e3-efe810e76c1c for instance cc4a1e6e-5d38-4c3e-8381-112022eb6207 on hv-cinder-78776 Nov 16 16:20:50.644103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-781afc38-94ae-4819-b3ed-f2f6257ed83a req-ce2b1d87-d54f-467d-af79-e77b467520de service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047497 Nov 16 16:20:50.645125 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 393/890] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:20:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:20:50.651625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b4bf30f1-cc75-4074-ad1a-8837ee0574c5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:50.653622 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b4bf30f1-cc75-4074-ad1a-8837ee0574c5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:50.670582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4bf30f1-cc75-4074-ad1a-8837ee0574c5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.671248 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4bf30f1-cc75-4074-ad1a-8837ee0574c5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.672212 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4bf30f1-cc75-4074-ad1a-8837ee0574c5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:50.673033 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b4bf30f1-cc75-4074-ad1a-8837ee0574c5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:50.753181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b4bf30f1-cc75-4074-ad1a-8837ee0574c5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.106173 Nov 16 16:20:50.759124 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 394/891] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:50 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:50.786402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:50.794399 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e422f965-6358-4582-aca3-db13288bf3cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.262849 Nov 16 16:20:50.794982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 498/892] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:50 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:51.544516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:51.545218 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] [instance: cc4a1e6e-5d38-4c3e-8381-112022eb6207] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:51.552504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.552965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.553740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.554181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.555870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:51.556773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] [instance: 1bec3e44-7feb-44da-a4d2-6655f7643bf0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:51.563378 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.563817 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.564589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.565242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.569102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] HTTP exception thrown: Instance cc4a1e6e-5d38-4c3e-8381-112022eb6207 could not be found. Nov 16 16:20:51.569705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] Returning 404 to user: Instance cc4a1e6e-5d38-4c3e-8381-112022eb6207 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:20:51.570639 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e7d544a9-f906-482b-a268-d50f17fb6273 tempest-AttachVolumeNegativeTest-98155327 tempest-AttachVolumeNegativeTest-98155327-project] 10.222.0.61 "GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207" status: 404 len: 111 microversion: 2.1 time: 0.030429 Nov 16 16:20:51.571414 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 395/893] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:51 2021] GET /compute/v2.1/servers/cc4a1e6e-5d38-4c3e-8381-112022eb6207 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:20:51.579742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] HTTP exception thrown: Instance 1bec3e44-7feb-44da-a4d2-6655f7643bf0 could not be found. Nov 16 16:20:51.580724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] Returning 404 to user: Instance 1bec3e44-7feb-44da-a4d2-6655f7643bf0 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:20:51.581517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e9d00d06-345f-4f58-92b0-68780eba2ebc tempest-VolumesSnapshotTestJSON-586667320 tempest-VolumesSnapshotTestJSON-586667320-project] 10.222.0.61 "GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0" status: 404 len: 111 microversion: 2.1 time: 0.029267 Nov 16 16:20:51.585067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 499/894] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:51 2021] GET /compute/v2.1/servers/1bec3e44-7feb-44da-a4d2-6655f7643bf0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:20:51.773182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7c40e6fc-32fe-4d28-ad23-ed29a26f3861 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:51.777003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7c40e6fc-32fe-4d28-ad23-ed29a26f3861 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:51.790286 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c40e6fc-32fe-4d28-ad23-ed29a26f3861 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.791337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c40e6fc-32fe-4d28-ad23-ed29a26f3861 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.793065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c40e6fc-32fe-4d28-ad23-ed29a26f3861 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.794323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c40e6fc-32fe-4d28-ad23-ed29a26f3861 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.816008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:51.817456 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:51.837612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.839250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.842021 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:51.843470 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:51.952312 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7c40e6fc-32fe-4d28-ad23-ed29a26f3861 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.185504 Nov 16 16:20:51.953971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 396/895] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:51 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:52.154819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:52.162615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-28dcdb03-5cd8-4ead-8ea0-da7198bfe5cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.354202 Nov 16 16:20:52.172315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 500/896] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:51 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:52.967208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7a8adb8a-7c3c-41aa-a430-b57c43b15987 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:52.969010 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7a8adb8a-7c3c-41aa-a430-b57c43b15987 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:52.979561 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a8adb8a-7c3c-41aa-a430-b57c43b15987 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:52.981357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a8adb8a-7c3c-41aa-a430-b57c43b15987 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:52.982487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a8adb8a-7c3c-41aa-a430-b57c43b15987 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:52.983115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7a8adb8a-7c3c-41aa-a430-b57c43b15987 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:53.067045 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7a8adb8a-7c3c-41aa-a430-b57c43b15987 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.105656 Nov 16 16:20:53.068557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 397/897] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:52 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:53.181657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:53.188646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:53.206680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:53.207421 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:53.214452 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:53.215306 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:53.494755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:53.502958 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3ecece39-4da6-4734-bf1a-dffdbbefc28d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.327470 Nov 16 16:20:53.503666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 501/898] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:53 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:54.079748 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ef3b01d4-94da-49b2-bf9c-500c84606f65 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:54.080971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ef3b01d4-94da-49b2-bf9c-500c84606f65 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:54.087794 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef3b01d4-94da-49b2-bf9c-500c84606f65 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:54.088290 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef3b01d4-94da-49b2-bf9c-500c84606f65 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:54.089701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef3b01d4-94da-49b2-bf9c-500c84606f65 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:54.090595 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ef3b01d4-94da-49b2-bf9c-500c84606f65 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:54.198053 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ef3b01d4-94da-49b2-bf9c-500c84606f65 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 0.121814 Nov 16 16:20:54.198953 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 398/899] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:54 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:54.526225 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:54.529446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:54.537129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:54.544489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:54.547332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:54.548010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:54.775603 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:54.804285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9a258b33-d2db-4364-b994-0f922a8e93f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.286950 Nov 16 16:20:54.804888 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 502/900] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:54 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:55.211139 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-53588a3d-093a-4789-8ab4-88eecc040434 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:55.212244 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-53588a3d-093a-4789-8ab4-88eecc040434 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:55.223970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53588a3d-093a-4789-8ab4-88eecc040434 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:55.224417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53588a3d-093a-4789-8ab4-88eecc040434 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:55.225225 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53588a3d-093a-4789-8ab4-88eecc040434 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:55.225661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53588a3d-093a-4789-8ab4-88eecc040434 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:55.820819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:55.821941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:55.828875 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:55.829632 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:55.830604 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:55.831193 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:56.020440 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:56.030295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ec002fdf-9c22-4a11-b604-5bc5dac34116 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.212918 Nov 16 16:20:56.047221 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 503/901] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:55 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:57.055571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:57.056212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:57.065679 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:57.069976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:57.069976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:57.069976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:57.226319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:57.235764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-84ddcd88-0c67-4867-b3d9-42b1fc06ef6a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.186619 Nov 16 16:20:57.237098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 504/902] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:57 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:57.672710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-53588a3d-093a-4789-8ab4-88eecc040434 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 29966 microversion: 2.1 time: 2.465743 Nov 16 16:20:57.673644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 399/903] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:55 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 29966 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:58.131017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e3ddce58-d8ae-4e4d-b435-841af0553d91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'create', calling method: .version_select at 0x7f3ec367d9d0>, body: {"keypair": {"name": "tempest-keypair-1750498430"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:58.151713 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-e3ddce58-d8ae-4e4d-b435-841af0553d91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:20:58.156400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-e3ddce58-d8ae-4e4d-b435-841af0553d91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for user 389db5ee5d9d4d59bf15b3b4001bfce1 and project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:20:58.255428 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:58.256478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:58.268258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:58.269844 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:58.270650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:58.271502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:58.462835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-e3ddce58-d8ae-4e4d-b435-841af0553d91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:20:58.469206 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-e3ddce58-d8ae-4e4d-b435-841af0553d91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for user 389db5ee5d9d4d59bf15b3b4001bfce1 and project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:20:58.488600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e3ddce58-d8ae-4e4d-b435-841af0553d91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.618200 Nov 16 16:20:58.489789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 505/904] 10.222.0.61 () {62 vars in 1198 bytes} [Tue Nov 16 16:20:57 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 621 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:20:58.578346 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:58.588248 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a7c035ed-6053-464d-a7ab-6cbcf9745a1b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.337849 Nov 16 16:20:58.590537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 400/905] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:58 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:20:58.686236 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3ca07c42-2925-4749-b4bc-293a77017ff7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:58.692610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3ca07c42-2925-4749-b4bc-293a77017ff7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:58.704444 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ca07c42-2925-4749-b4bc-293a77017ff7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:58.705184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ca07c42-2925-4749-b4bc-293a77017ff7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:58.706226 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ca07c42-2925-4749-b4bc-293a77017ff7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:58.706714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3ca07c42-2925-4749-b4bc-293a77017ff7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:58.894801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3ca07c42-2925-4749-b4bc-293a77017ff7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 31266 microversion: 2.1 time: 0.211929 Nov 16 16:20:58.896240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 506/906] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:58 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 31266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:20:59.611388 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:20:59.611889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:59.619781 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:59.620511 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:59.621679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:59.622278 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:59.867161 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:20:59.881618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9a688a5c-18d3-4d76-b75e-f23c21099747 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.277640 Nov 16 16:20:59.883568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 401/907] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:20:59 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:20:59.908650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d6f8ba29-9942-4d71-9b24-a1b676900d08 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:20:59.910513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d6f8ba29-9942-4d71-9b24-a1b676900d08 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:20:59.919538 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6f8ba29-9942-4d71-9b24-a1b676900d08 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:59.920018 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6f8ba29-9942-4d71-9b24-a1b676900d08 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:20:59.920901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6f8ba29-9942-4d71-9b24-a1b676900d08 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:20:59.921371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d6f8ba29-9942-4d71-9b24-a1b676900d08 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:00.000449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d6f8ba29-9942-4d71-9b24-a1b676900d08 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 33290 microversion: 2.1 time: 0.096498 Nov 16 16:21:00.005469 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 507/908] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:20:59 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 33290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:21:00.217486 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-470126484", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9573b352-3f35-4265-9888-1c7a2a928315"}], "security_groups": [{"name": "tempest-securitygroup--1388274326"}], "key_name": "tempest-keypair-1750498430", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:00.329766 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] validate_networks() for [('9573b352-3f35-4265-9888-1c7a2a928315', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:21:00.716260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-60b9c700-ff32-4334-a9e5-069f37ab7fe5 req-dfdc8ea0-cb0f-4f42-bae1-8d0f5bf9dd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb3995-5e51-438c-932d-e5740e28c38e", "name": "network-vif-plugged", "status": "completed", "tag": "e73fa700-ec5c-41fb-b99b-cd813ff621b5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:00.717785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:21:00.717785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:21:00.731778 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-60b9c700-ff32-4334-a9e5-069f37ab7fe5 req-dfdc8ea0-cb0f-4f42-bae1-8d0f5bf9dd4a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:00.732214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-60b9c700-ff32-4334-a9e5-069f37ab7fe5 req-dfdc8ea0-cb0f-4f42-bae1-8d0f5bf9dd4a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:00.761209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-60b9c700-ff32-4334-a9e5-069f37ab7fe5 req-dfdc8ea0-cb0f-4f42-bae1-8d0f5bf9dd4a service nova] Creating event network-vif-plugged:e73fa700-ec5c-41fb-b99b-cd813ff621b5 for instance 78eb3995-5e51-438c-932d-e5740e28c38e on hv-cinder-78776 Nov 16 16:21:00.784795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-60b9c700-ff32-4334-a9e5-069f37ab7fe5 req-dfdc8ea0-cb0f-4f42-bae1-8d0f5bf9dd4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183951 Nov 16 16:21:00.786423 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 508/909] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:21:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:21:00.900901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:00.901959 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:00.906304 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:21:00.906887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:21:00.909636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:21:00.910148 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:21:00.910814 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:21:00.916129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:00.916725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:00.918031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:00.918496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:00.925576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:00.926323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:00.927409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:00.928356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:00.968027 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:21:00.975157 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for user 389db5ee5d9d4d59bf15b3b4001bfce1 and project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:21:01.002298 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:21:01.007397 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:21:01.139820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-837357c9-72e1-4cd7-8543-2ebd5c972896 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.926923 Nov 16 16:21:01.144058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 402/910] 10.222.0.61 () {62 vars in 1187 bytes} [Tue Nov 16 16:21:00 2021] POST /compute/v2.1/servers => generated 402 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 16 16:21:01.171839 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-117e4b1f-b96c-43f6-a020-54ed6b543d55 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:01.172846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-117e4b1f-b96c-43f6-a020-54ed6b543d55 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:01.189857 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117e4b1f-b96c-43f6-a020-54ed6b543d55 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:01.190308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117e4b1f-b96c-43f6-a020-54ed6b543d55 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:01.196085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117e4b1f-b96c-43f6-a020-54ed6b543d55 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:01.196546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-117e4b1f-b96c-43f6-a020-54ed6b543d55 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:01.216559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:01.228818 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2aa8353f-bc72-4345-b49d-63e938b2ddb9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.332233 Nov 16 16:21:01.231486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 509/911] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:00 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:21:01.240222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6f03c460-3f46-4898-816a-4e5864812959 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:01.241519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6f03c460-3f46-4898-816a-4e5864812959 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:01.361372 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6f03c460-3f46-4898-816a-4e5864812959 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:01.384610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6f03c460-3f46-4898-816a-4e5864812959 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:01.387089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6f03c460-3f46-4898-816a-4e5864812959 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:01.388462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6f03c460-3f46-4898-816a-4e5864812959 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1281 microversion: 2.20 time: 0.154893 Nov 16 16:21:01.389230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 510/912] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:01 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:01.436536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-117e4b1f-b96c-43f6-a020-54ed6b543d55 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 34711 microversion: 2.1 time: 0.286327 Nov 16 16:21:01.438203 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 403/913] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:01 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 34711 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:21:02.248182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:02.250711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:02.260767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:02.261211 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:02.262302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:02.262906 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:02.418792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:02.422920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:02.426092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:02.436589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-41c18cd7-b856-4b5e-ad7d-31d94daa22cf tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1260 microversion: 2.1 time: 0.193025 Nov 16 16:21:02.448007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 511/914] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:02 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:02.451656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:02.452169 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:02.452987 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:02.453728 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:02.456806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-362cc02d-7206-4cd3-8799-eb607f03d9ca tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:02.457811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-362cc02d-7206-4cd3-8799-eb607f03d9ca tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:02.464266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-362cc02d-7206-4cd3-8799-eb607f03d9ca tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:02.464733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-362cc02d-7206-4cd3-8799-eb607f03d9ca tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:02.465521 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-362cc02d-7206-4cd3-8799-eb607f03d9ca tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:02.465950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-362cc02d-7206-4cd3-8799-eb607f03d9ca tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:02.544631 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-362cc02d-7206-4cd3-8799-eb607f03d9ca tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 35677 microversion: 2.1 time: 0.091799 Nov 16 16:21:02.545373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 512/915] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:02 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 35677 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:21:02.547697 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:02.563771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:02.566672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:02.568196 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7bd182af-9d13-4238-a7ea-f29642109ddc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1333 microversion: 2.20 time: 0.154614 Nov 16 16:21:02.568579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 404/916] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:02 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:03.458196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:03.458925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:03.466179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.466654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:03.467475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.467909 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:03.556456 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-799bbdd8-3505-47f0-a4d0-f5a59f31b9b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:03.557558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-799bbdd8-3505-47f0-a4d0-f5a59f31b9b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:03.564410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-799bbdd8-3505-47f0-a4d0-f5a59f31b9b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.564777 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-799bbdd8-3505-47f0-a4d0-f5a59f31b9b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:03.565593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-799bbdd8-3505-47f0-a4d0-f5a59f31b9b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.566103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-799bbdd8-3505-47f0-a4d0-f5a59f31b9b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:03.699350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:03.706852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0761dffc-b4fd-4f88-888c-075cab1da3f9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1445 microversion: 2.1 time: 0.253291 Nov 16 16:21:03.707429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 513/917] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:03 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1445 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:03.711854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:03.712492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:03.719914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.720388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:03.721191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.721652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:03.791661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:03.800789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:03.802488 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:03.803957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a4a4fc07-93ee-4af2-ac1d-a7d86baea213 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1339 microversion: 2.20 time: 0.095508 Nov 16 16:21:03.805000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 514/918] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:03 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1339 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:03.809954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:03.810595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:03.821333 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.821696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:03.822555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:03.822985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:04.218008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:04.225563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0ba18dd7-f553-4503-86be-b26b6050b697 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1445 microversion: 2.1 time: 0.419420 Nov 16 16:21:04.226323 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 515/919] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:03 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1445 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:04.823782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:04.824612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:04.835547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:04.836569 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:04.836825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:04.839903 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:04.933352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:04.946669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:04.949622 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:04.952270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-47abbafb-cd75-4193-8b3b-9e18e5549d57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1339 microversion: 2.20 time: 0.132531 Nov 16 16:21:04.953200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 516/920] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:04 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:05.978839 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:05.980822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:05.992838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:05.993651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:05.995221 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:05.995943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:06.094478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:06.105859 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:06.108405 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:06.109785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-14c122c8-3881-4dd4-af2f-b60a1692ab63 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1339 microversion: 2.20 time: 0.138928 Nov 16 16:21:06.110558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 517/921] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:05 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:21:06.476982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-a004d72b-cb43-441b-bef7-b7cc80db651e req-5b302d46-e524-449e-b8c8-83060fb84b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78eb3995-5e51-438c-932d-e5740e28c38e", "tag": "e73fa700-ec5c-41fb-b99b-cd813ff621b5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:06.478527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:21:06.478527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:21:06.489651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a004d72b-cb43-441b-bef7-b7cc80db651e req-5b302d46-e524-449e-b8c8-83060fb84b68 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:06.490097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a004d72b-cb43-441b-bef7-b7cc80db651e req-5b302d46-e524-449e-b8c8-83060fb84b68 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:06.511769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-a004d72b-cb43-441b-bef7-b7cc80db651e req-5b302d46-e524-449e-b8c8-83060fb84b68 service nova] Creating event network-changed:e73fa700-ec5c-41fb-b99b-cd813ff621b5 for instance 78eb3995-5e51-438c-932d-e5740e28c38e on hv-cinder-78776 Nov 16 16:21:06.521917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-a004d72b-cb43-441b-bef7-b7cc80db651e req-5b302d46-e524-449e-b8c8-83060fb84b68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044688 Nov 16 16:21:06.528476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 518/922] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:21:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:21:06.724058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-799bbdd8-3505-47f0-a4d0-f5a59f31b9b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 39424 microversion: 2.1 time: 3.171118 Nov 16 16:21:06.726316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 405/923] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:03 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 39424 bytes in 3174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:21:07.129216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:07.129938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:07.136763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:07.137573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:07.138808 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:07.139580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:07.238798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:07.251033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:07.255029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:07.256525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4963645b-44d5-4b1c-8a92-bbc9baeb4fc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1339 microversion: 2.20 time: 0.131921 Nov 16 16:21:07.257698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 519/924] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:07 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:07.737637 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b739d654-121e-4116-bfbd-30f598f3ca82 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:07.738819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b739d654-121e-4116-bfbd-30f598f3ca82 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:07.769680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b739d654-121e-4116-bfbd-30f598f3ca82 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:07.770474 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b739d654-121e-4116-bfbd-30f598f3ca82 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:07.771494 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b739d654-121e-4116-bfbd-30f598f3ca82 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:07.772089 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b739d654-121e-4116-bfbd-30f598f3ca82 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:08.277811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:08.279059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:08.289065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:08.289520 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:08.290340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:08.290860 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:08.676289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:08.690598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:08.693654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:08.695466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bd23d820-76aa-4c91-8034-ab787565487e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.422520 Nov 16 16:21:08.696293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 520/925] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:08 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:21:08.792014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-d714cf0a-ee83-4f0b-ab68-9b8849b64072 req-3fd63489-4fcd-4e3e-9b60-6c58bac06ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be607369-0706-46d3-9745-8e5549afb1ec", "tag": "8b0ab530-8322-4d7c-a925-57b347432f28"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:08.794571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:21:08.794571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:21:08.824931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-d714cf0a-ee83-4f0b-ab68-9b8849b64072 req-3fd63489-4fcd-4e3e-9b60-6c58bac06ce2 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:08.825507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-d714cf0a-ee83-4f0b-ab68-9b8849b64072 req-3fd63489-4fcd-4e3e-9b60-6c58bac06ce2 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:08.847199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-d714cf0a-ee83-4f0b-ab68-9b8849b64072 req-3fd63489-4fcd-4e3e-9b60-6c58bac06ce2 service nova] Creating event network-changed:8b0ab530-8322-4d7c-a925-57b347432f28 for instance be607369-0706-46d3-9745-8e5549afb1ec on hv-cinder-78776 Nov 16 16:21:08.853109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-d714cf0a-ee83-4f0b-ab68-9b8849b64072 req-3fd63489-4fcd-4e3e-9b60-6c58bac06ce2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067517 Nov 16 16:21:08.854263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 521/926] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:21:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:21:09.714923 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:09.715637 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:09.722502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:09.722961 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:09.723745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:09.724169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:09.865718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:09.890153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:09.892096 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:09.893269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0e621cea-9f34-42db-aeb7-8bb9264b5478 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.183184 Nov 16 16:21:09.894143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 522/927] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:09 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:21:10.917753 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:10.919075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:10.932504 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:10.933543 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:10.935515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:10.935515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:11.123473 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:11.132562 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:11.134048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:11.135211 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4fbc1ebb-0e57-499f-99bb-85dfe1352196 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.226609 Nov 16 16:21:11.135768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 523/928] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:10 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:21:11.569558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b739d654-121e-4116-bfbd-30f598f3ca82 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 39493 microversion: 2.1 time: 3.835830 Nov 16 16:21:11.570394 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 406/929] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:07 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 39493 bytes in 3838 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:21:12.155655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:12.156938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:12.166645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:12.168059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:12.169316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:12.169780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:12.583133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1021292c-82a5-41f2-a7c1-9c26927e7f11 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:12.585035 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1021292c-82a5-41f2-a7c1-9c26927e7f11 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:12.632168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1021292c-82a5-41f2-a7c1-9c26927e7f11 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:12.633211 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1021292c-82a5-41f2-a7c1-9c26927e7f11 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:12.636878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1021292c-82a5-41f2-a7c1-9c26927e7f11 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:12.637880 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1021292c-82a5-41f2-a7c1-9c26927e7f11 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:12.765121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1021292c-82a5-41f2-a7c1-9c26927e7f11 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 39493 microversion: 2.1 time: 0.186049 Nov 16 16:21:12.766710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 407/930] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:12 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 39493 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:21:13.338678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:13.349544 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:13.355981 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:13.359580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-13efd9a6-1b93-40fd-bf22-2366c1351e47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 1.210361 Nov 16 16:21:13.361165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 524/931] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:12 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:13.781815 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8eae7817-5e7d-4123-86ab-f03971f83e24 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:13.786450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8eae7817-5e7d-4123-86ab-f03971f83e24 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:13.796121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eae7817-5e7d-4123-86ab-f03971f83e24 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:13.796699 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eae7817-5e7d-4123-86ab-f03971f83e24 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:13.797756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eae7817-5e7d-4123-86ab-f03971f83e24 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:13.798575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8eae7817-5e7d-4123-86ab-f03971f83e24 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:14.159185 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8eae7817-5e7d-4123-86ab-f03971f83e24 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 200 len: 39620 microversion: 2.1 time: 0.376488 Nov 16 16:21:14.160898 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 408/932] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:13 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 39620 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:21:14.174315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-58986ad6-8f61-4e48-bc3d-7ec376f6fd62 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:14.175402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-58986ad6-8f61-4e48-bc3d-7ec376f6fd62 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:14.188260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58986ad6-8f61-4e48-bc3d-7ec376f6fd62 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:14.189863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58986ad6-8f61-4e48-bc3d-7ec376f6fd62 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:14.191070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58986ad6-8f61-4e48-bc3d-7ec376f6fd62 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:14.191681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-58986ad6-8f61-4e48-bc3d-7ec376f6fd62 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:14.229266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-58986ad6-8f61-4e48-bc3d-7ec376f6fd62 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/ips" status: 200 len: 146 microversion: 2.1 time: 0.061676 Nov 16 16:21:14.229975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 525/933] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Nov 16 16:21:14 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/ips => generated 146 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:21:14.388002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:14.388762 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:14.395930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:14.396473 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:14.397349 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:14.397842 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:14.578029 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:14.586872 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:14.588473 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:14.590080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1db84c57-1e92-41eb-bbac-a71de0db328b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.207562 Nov 16 16:21:14.591018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 409/934] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:14 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:14.644836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-161263de-1d63-464d-9a31-8d9293aec6d6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Action: 'create', calling method: .version_select at 0x7f3ec3f4f040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1284105524"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:14.669560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-161263de-1d63-464d-9a31-8d9293aec6d6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:21:14.674456 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-161263de-1d63-464d-9a31-8d9293aec6d6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for user bd94e07e5a7d49398e9118053fc13c69 and project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:21:14.928478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-161263de-1d63-464d-9a31-8d9293aec6d6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:21:14.932471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-161263de-1d63-464d-9a31-8d9293aec6d6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for user bd94e07e5a7d49398e9118053fc13c69 and project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:21:14.946162 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-161263de-1d63-464d-9a31-8d9293aec6d6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.529221 Nov 16 16:21:14.946977 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 526/935] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Nov 16 16:21:14 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:15.615572 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:15.616157 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:15.624777 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:15.625233 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:15.626038 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:15.626516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:15.891768 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:15.906332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:15.908213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:15.909603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-11a47633-0540-498a-8c12-c38fbc1d8305 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.299115 Nov 16 16:21:15.910169 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 410/936] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:15 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:16.916852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9886dd25-520c-4313-a562-77f13654163d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4203248-71b4-45cf-a6d8-54aafc77c38f"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:16.918980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9886dd25-520c-4313-a562-77f13654163d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:16.927702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9886dd25-520c-4313-a562-77f13654163d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:16.928507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9886dd25-520c-4313-a562-77f13654163d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:16.928947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:16.929633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:16.930412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9886dd25-520c-4313-a562-77f13654163d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:16.931614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9886dd25-520c-4313-a562-77f13654163d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:16.942718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:16.942718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:16.942718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:16.942718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:17.208342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:17.218764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:17.220576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:17.222176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-93d74216-3812-4039-9102-18933bb29fc5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.297173 Nov 16 16:21:17.223077 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 411/937] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:16 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:21:17.314926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9886dd25-520c-4313-a562-77f13654163d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.402788 Nov 16 16:21:17.315641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 527/938] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:21:16 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-volume_attachments => generated 194 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:21:18.243481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:18.244273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:18.251049 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:18.251640 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:18.252543 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:18.256547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:18.457437 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:18.466532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:18.478462 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:18.483634 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4b3b1420-56bb-4f76-9bd0-6e7bc15beb6e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.244921 Nov 16 16:21:18.497232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 412/939] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:18 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:19.503851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:19.504247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:19.521960 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:19.522338 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:19.523551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:19.524045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:19.694009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:19.703305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:19.704787 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:19.705950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b5486ead-7b41-46f2-b7b2-f864a6d52ee6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.207554 Nov 16 16:21:19.706477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 528/940] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:19 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:20.596565 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-6f5e4b2f-7efd-49f2-9f43-9b7635b59039 req-b557fbaf-e4ad-4518-8f96-4eb81146e9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be607369-0706-46d3-9745-8e5549afb1ec", "name": "network-vif-plugged", "status": "completed", "tag": "8b0ab530-8322-4d7c-a925-57b347432f28"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:20.598853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:21:20.598853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:21:20.606574 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-6f5e4b2f-7efd-49f2-9f43-9b7635b59039 req-b557fbaf-e4ad-4518-8f96-4eb81146e9e7 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:20.607010 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-6f5e4b2f-7efd-49f2-9f43-9b7635b59039 req-b557fbaf-e4ad-4518-8f96-4eb81146e9e7 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:20.620133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-6f5e4b2f-7efd-49f2-9f43-9b7635b59039 req-b557fbaf-e4ad-4518-8f96-4eb81146e9e7 service nova] Creating event network-vif-plugged:8b0ab530-8322-4d7c-a925-57b347432f28 for instance be607369-0706-46d3-9745-8e5549afb1ec on hv-cinder-78776 Nov 16 16:21:20.633090 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-6f5e4b2f-7efd-49f2-9f43-9b7635b59039 req-b557fbaf-e4ad-4518-8f96-4eb81146e9e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040197 Nov 16 16:21:20.634151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 413/941] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:21:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:21:20.725345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:20.726642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:20.734548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:20.735246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:20.736181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:20.736854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:20.957133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:20.965623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:20.967136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:20.968241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-47bd1992-aa8b-46f6-b723-f0e2565811a7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.247749 Nov 16 16:21:20.968966 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 529/942] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:20 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:21.987649 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:21.988347 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:21.995092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:21.995538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:21.996370 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:21.996817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:22.136200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:22.146991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:22.148867 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:22.150044 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-56fc4564-9692-44fe-bb43-fd550c1b7baf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1407 microversion: 2.20 time: 0.167218 Nov 16 16:21:22.150637 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 414/943] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:21 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:23.168523 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:23.170000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:23.176920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:23.177470 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:23.178394 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:23.178928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:23.344091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:23.353398 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:23.355914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:23.357165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c73d8146-ee52-4d24-a011-85c2cfa52985 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1600 microversion: 2.20 time: 0.192370 Nov 16 16:21:23.357722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 530/944] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:21:23 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1600 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:21:23.375621 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-40589a25-ac83-4099-8957-6ce36eff6302 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:23.376260 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-40589a25-ac83-4099-8957-6ce36eff6302 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:23.383093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40589a25-ac83-4099-8957-6ce36eff6302 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:23.383647 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40589a25-ac83-4099-8957-6ce36eff6302 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:23.384318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40589a25-ac83-4099-8957-6ce36eff6302 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:23.386093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40589a25-ac83-4099-8957-6ce36eff6302 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:23.477962 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-40589a25-ac83-4099-8957-6ce36eff6302 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105770 Nov 16 16:21:23.479123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 415/945] 10.222.0.61 () {60 vars in 1315 bytes} [Tue Nov 16 16:21:23 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:21:24.678407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-9849f322-902d-49a1-8334-bae36f54228f req-c68af12d-03a5-43fa-9e7c-20c2d132b87a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be607369-0706-46d3-9745-8e5549afb1ec", "tag": "8b0ab530-8322-4d7c-a925-57b347432f28"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:24.680540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5b491686-0d43-4d4f-a5f0-c9531e63deae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:24.681617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5b491686-0d43-4d4f-a5f0-c9531e63deae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:24.682931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:21:24.682931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:21:24.692238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5b491686-0d43-4d4f-a5f0-c9531e63deae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:24.692934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5b491686-0d43-4d4f-a5f0-c9531e63deae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:24.695503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5b491686-0d43-4d4f-a5f0-c9531e63deae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:24.696044 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5b491686-0d43-4d4f-a5f0-c9531e63deae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:24.704502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-9849f322-902d-49a1-8334-bae36f54228f req-c68af12d-03a5-43fa-9e7c-20c2d132b87a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:24.705236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-9849f322-902d-49a1-8334-bae36f54228f req-c68af12d-03a5-43fa-9e7c-20c2d132b87a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:24.736146 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-9849f322-902d-49a1-8334-bae36f54228f req-c68af12d-03a5-43fa-9e7c-20c2d132b87a service nova] Creating event network-changed:8b0ab530-8322-4d7c-a925-57b347432f28 for instance be607369-0706-46d3-9745-8e5549afb1ec on hv-cinder-78776 Nov 16 16:21:24.742614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-9849f322-902d-49a1-8334-bae36f54228f req-c68af12d-03a5-43fa-9e7c-20c2d132b87a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074136 Nov 16 16:21:24.746980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 416/946] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:21:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:21:24.798681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5b491686-0d43-4d4f-a5f0-c9531e63deae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.127635 Nov 16 16:21:24.802089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 531/947] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:24 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:24.968603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-97dc9b4f-14c2-4a35-a039-152613a5a6ba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:24.975655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-97dc9b4f-14c2-4a35-a039-152613a5a6ba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:24.976174 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-97dc9b4f-14c2-4a35-a039-152613a5a6ba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:25.051428 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-97dc9b4f-14c2-4a35-a039-152613a5a6ba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Going to try to stop instance {{(pid=116168) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 16 16:21:25.114123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-97dc9b4f-14c2-4a35-a039-152613a5a6ba tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 202 len: 0 microversion: 2.1 time: 0.149387 Nov 16 16:21:25.117765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 417/948] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:24 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:25.123892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:25.125147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:25.147352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:25.149232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:25.150248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:25.150852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:25.427862 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:25.437633 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a12397f4-b5fb-4511-a4f5-437b61844243 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.317749 Nov 16 16:21:25.438874 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 532/949] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:25 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:25.810600 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bc4e4939-f35a-4050-85ae-05fabe04f4e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:25.811682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bc4e4939-f35a-4050-85ae-05fabe04f4e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:25.819403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc4e4939-f35a-4050-85ae-05fabe04f4e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:25.819403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc4e4939-f35a-4050-85ae-05fabe04f4e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:25.821369 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc4e4939-f35a-4050-85ae-05fabe04f4e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:25.821369 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc4e4939-f35a-4050-85ae-05fabe04f4e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:25.894417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bc4e4939-f35a-4050-85ae-05fabe04f4e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.088669 Nov 16 16:21:25.897797 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 418/950] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:25 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:26.455233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:26.455966 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:26.462297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:26.462767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:26.463527 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:26.463956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:26.604589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:26.612697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-66926a77-29cb-4036-bcba-f7cffd7ced95 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.161115 Nov 16 16:21:26.613291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 533/951] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:26 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:26.905955 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-154b67d6-ec7d-4a09-b6a6-1e302a208279 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:26.907039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-154b67d6-ec7d-4a09-b6a6-1e302a208279 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:26.917930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-154b67d6-ec7d-4a09-b6a6-1e302a208279 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:26.918343 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-154b67d6-ec7d-4a09-b6a6-1e302a208279 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:26.919251 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-154b67d6-ec7d-4a09-b6a6-1e302a208279 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:26.919844 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-154b67d6-ec7d-4a09-b6a6-1e302a208279 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:26.984497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-154b67d6-ec7d-4a09-b6a6-1e302a208279 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.082458 Nov 16 16:21:26.985424 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 419/952] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:26 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:27.629900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:27.630575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:27.637167 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:27.637607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:27.638530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:27.638938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:27.775327 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:27.783909 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-be5d8917-4b9f-4bba-a525-2bdb988b3671 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.157940 Nov 16 16:21:27.784760 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 534/953] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:27 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:27.996864 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-41c54613-a29b-46f2-a53c-3b79fb795b84 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:27.997842 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-41c54613-a29b-46f2-a53c-3b79fb795b84 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:28.005432 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41c54613-a29b-46f2-a53c-3b79fb795b84 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:28.005873 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41c54613-a29b-46f2-a53c-3b79fb795b84 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:28.006701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41c54613-a29b-46f2-a53c-3b79fb795b84 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:28.007131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-41c54613-a29b-46f2-a53c-3b79fb795b84 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:28.084878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-41c54613-a29b-46f2-a53c-3b79fb795b84 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.092208 Nov 16 16:21:28.085534 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 420/954] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:27 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:28.801803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:28.802430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:28.809032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:28.809483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:28.810289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:28.810755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:28.957289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:28.965169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-963b8258-2c55-4634-8b8a-fc7cb4506900 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.167213 Nov 16 16:21:28.965733 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 535/955] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:28 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:29.098699 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d690901a-c437-42c6-9469-ffd781be9165 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:29.099695 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d690901a-c437-42c6-9469-ffd781be9165 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:29.106986 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d690901a-c437-42c6-9469-ffd781be9165 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:29.107451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d690901a-c437-42c6-9469-ffd781be9165 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:29.108208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d690901a-c437-42c6-9469-ffd781be9165 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:29.108652 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d690901a-c437-42c6-9469-ffd781be9165 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:29.170073 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d690901a-c437-42c6-9469-ffd781be9165 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.075675 Nov 16 16:21:29.170841 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 421/956] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:29 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:29.983449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:29.984062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:29.992246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:29.992710 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:29.993543 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:29.993980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:30.133312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:30.142140 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b0db8fce-86a4-4210-b0b1-a711a0d6c59a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.162403 Nov 16 16:21:30.142789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 536/957] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:29 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:30.181745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8f925c1d-939e-4cc2-b216-37096af4b7ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:30.182765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8f925c1d-939e-4cc2-b216-37096af4b7ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:30.190072 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f925c1d-939e-4cc2-b216-37096af4b7ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:30.190555 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f925c1d-939e-4cc2-b216-37096af4b7ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:30.191335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f925c1d-939e-4cc2-b216-37096af4b7ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:30.191764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f925c1d-939e-4cc2-b216-37096af4b7ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:30.265576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8f925c1d-939e-4cc2-b216-37096af4b7ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.087443 Nov 16 16:21:30.266672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 422/958] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:30 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:31.160325 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:31.160946 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:31.168003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:31.168428 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:31.169205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:31.169630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:31.284976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-153d178a-01ec-4f42-a7a8-8384d78ccdab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:31.286960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-153d178a-01ec-4f42-a7a8-8384d78ccdab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:31.294973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-153d178a-01ec-4f42-a7a8-8384d78ccdab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:31.295653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-153d178a-01ec-4f42-a7a8-8384d78ccdab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:31.296464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-153d178a-01ec-4f42-a7a8-8384d78ccdab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:31.296851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-153d178a-01ec-4f42-a7a8-8384d78ccdab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:31.319773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:31.327823 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8039cda5-1191-4def-9d90-a30207243d75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.171379 Nov 16 16:21:31.328877 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 537/959] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:31 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:31.367970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-153d178a-01ec-4f42-a7a8-8384d78ccdab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.093485 Nov 16 16:21:31.368695 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 423/960] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:31 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:32.347767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:32.348718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:32.359036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:32.359745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:32.361177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:32.361610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:32.380115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9614ad9c-97d6-4ef9-b450-267e29f2ce7c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:32.381648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9614ad9c-97d6-4ef9-b450-267e29f2ce7c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:32.388879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9614ad9c-97d6-4ef9-b450-267e29f2ce7c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:32.389331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9614ad9c-97d6-4ef9-b450-267e29f2ce7c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:32.390224 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9614ad9c-97d6-4ef9-b450-267e29f2ce7c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:32.390598 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9614ad9c-97d6-4ef9-b450-267e29f2ce7c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:32.455840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9614ad9c-97d6-4ef9-b450-267e29f2ce7c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.080026 Nov 16 16:21:32.459131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 424/961] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:32 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:32.577158 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:32.587628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-88ff5e8b-8337-438d-b1bb-6dbd3f9ea453 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.245532 Nov 16 16:21:32.588144 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 538/962] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:32 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:33.467694 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b6bac8b7-6fdb-4439-be01-2f29f0a95f3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:33.468692 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b6bac8b7-6fdb-4439-be01-2f29f0a95f3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:33.475851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6bac8b7-6fdb-4439-be01-2f29f0a95f3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:33.476295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6bac8b7-6fdb-4439-be01-2f29f0a95f3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:33.477176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6bac8b7-6fdb-4439-be01-2f29f0a95f3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:33.477493 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6bac8b7-6fdb-4439-be01-2f29f0a95f3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:33.538338 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b6bac8b7-6fdb-4439-be01-2f29f0a95f3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.074703 Nov 16 16:21:33.539467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 425/963] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:33 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:33.605052 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:33.605853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:33.612414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:33.612856 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:33.613785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:33.614209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:33.809362 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:33.818976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-972f30ec-d8af-489e-bfa2-d59af10d029a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.217699 Nov 16 16:21:33.819526 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 539/964] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:33 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:34.550316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-67b1b9e4-c812-4762-b20f-64371d02d318 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:34.551342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-67b1b9e4-c812-4762-b20f-64371d02d318 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:34.558313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67b1b9e4-c812-4762-b20f-64371d02d318 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:34.558907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67b1b9e4-c812-4762-b20f-64371d02d318 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:34.559667 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67b1b9e4-c812-4762-b20f-64371d02d318 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:34.560121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-67b1b9e4-c812-4762-b20f-64371d02d318 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:34.626634 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-67b1b9e4-c812-4762-b20f-64371d02d318 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.080436 Nov 16 16:21:34.627322 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 426/965] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:34 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:21:34.836514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:34.837224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:34.843744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:34.844270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:34.845282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:34.845962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:34.977732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:34.985847 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ee82d795-c23d-4b4f-90ff-eaacbff68b80 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.152997 Nov 16 16:21:34.986372 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 540/966] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:34 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:35.638729 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3d48c90f-8c9d-411b-9dbc-8ad0ad6990f8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:35.640477 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3d48c90f-8c9d-411b-9dbc-8ad0ad6990f8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:35.647957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d48c90f-8c9d-411b-9dbc-8ad0ad6990f8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:35.648605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d48c90f-8c9d-411b-9dbc-8ad0ad6990f8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:35.649391 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d48c90f-8c9d-411b-9dbc-8ad0ad6990f8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:35.650008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d48c90f-8c9d-411b-9dbc-8ad0ad6990f8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:35.739402 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3d48c90f-8c9d-411b-9dbc-8ad0ad6990f8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.104930 Nov 16 16:21:35.740153 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 427/967] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:35 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:36.003901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:36.004535 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:36.011059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:36.011515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:36.012293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:36.012718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:36.161278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:36.169164 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3c301622-a801-4e48-907f-f54ae356385f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.169324 Nov 16 16:21:36.169842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 541/968] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:35 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:36.752200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-752c87ad-ceb0-44aa-82f0-810559c63040 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:36.753320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-752c87ad-ceb0-44aa-82f0-810559c63040 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:36.760292 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-752c87ad-ceb0-44aa-82f0-810559c63040 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:36.760756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-752c87ad-ceb0-44aa-82f0-810559c63040 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:36.761535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-752c87ad-ceb0-44aa-82f0-810559c63040 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:36.761957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-752c87ad-ceb0-44aa-82f0-810559c63040 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:36.824217 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-752c87ad-ceb0-44aa-82f0-810559c63040 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 14 microversion: 2.20 time: 0.076527 Nov 16 16:21:36.824898 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 428/969] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:36 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:37.190183 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:37.190850 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:37.197714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:37.198165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:37.198988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:37.199418 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:37.340701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:37.348969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-af212244-84d2-456d-9596-a22aab025150 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.164763 Nov 16 16:21:37.349503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 542/970] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:37 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:37.840185 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-81c992ce-538f-48a1-a09f-568111f2a5fd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:37.841796 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-81c992ce-538f-48a1-a09f-568111f2a5fd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:37.850711 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c992ce-538f-48a1-a09f-568111f2a5fd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:37.851161 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c992ce-538f-48a1-a09f-568111f2a5fd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:37.851939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c992ce-538f-48a1-a09f-568111f2a5fd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:37.852370 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c992ce-538f-48a1-a09f-568111f2a5fd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:37.929377 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-81c992ce-538f-48a1-a09f-568111f2a5fd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 10367 microversion: 2.20 time: 0.096066 Nov 16 16:21:37.930095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 429/971] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:37 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 10367 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:38.366060 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:38.366720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:38.373727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:38.374217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:38.375156 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:38.375508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:38.532106 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:38.540604 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-21d2fb82-d694-449b-9f56-96e722bd449e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.178558 Nov 16 16:21:38.541171 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 543/972] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:38 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:21:38.944325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d4f326ea-3bb2-4afa-9a4e-e4d726ebd31f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:38.945542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d4f326ea-3bb2-4afa-9a4e-e4d726ebd31f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:38.955119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f326ea-3bb2-4afa-9a4e-e4d726ebd31f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:38.955719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f326ea-3bb2-4afa-9a4e-e4d726ebd31f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:38.956783 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f326ea-3bb2-4afa-9a4e-e4d726ebd31f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:38.957220 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d4f326ea-3bb2-4afa-9a4e-e4d726ebd31f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:39.031359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d4f326ea-3bb2-4afa-9a4e-e4d726ebd31f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 17354 microversion: 2.20 time: 0.092553 Nov 16 16:21:39.032413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 430/973] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:38 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 17354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:39.557340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:39.557943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:39.565013 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:39.565530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:39.566359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:39.566820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:39.756529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:39.764606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0a4a988d-f165-44ab-b2f1-230a7c2480bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1722 microversion: 2.1 time: 0.211140 Nov 16 16:21:39.765155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 544/974] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:39 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:40.045905 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4a96e73f-872f-44bd-bf9c-15e12af3f4c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:40.047109 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4a96e73f-872f-44bd-bf9c-15e12af3f4c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:40.054740 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a96e73f-872f-44bd-bf9c-15e12af3f4c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:40.055266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a96e73f-872f-44bd-bf9c-15e12af3f4c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:40.056114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a96e73f-872f-44bd-bf9c-15e12af3f4c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:40.056616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4a96e73f-872f-44bd-bf9c-15e12af3f4c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:40.130622 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4a96e73f-872f-44bd-bf9c-15e12af3f4c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 18498 microversion: 2.20 time: 0.088759 Nov 16 16:21:40.131298 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 431/975] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:40 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 18498 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:40.782639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:40.783291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:40.790402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:40.790854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:40.791657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:40.792081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:40.939388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:40.948051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4903e0fa-4132-4d8a-89da-06cf02556bd2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1699 microversion: 2.1 time: 0.169201 Nov 16 16:21:40.948767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 545/976] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:40 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1699 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:40.964984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-824c34c4-4858-4982-b664-f7e3eca78dd5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:40.972861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-824c34c4-4858-4982-b664-f7e3eca78dd5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:40.973291 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-824c34c4-4858-4982-b664-f7e3eca78dd5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:40.996604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-824c34c4-4858-4982-b664-f7e3eca78dd5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Going to try to start instance {{(pid=116168) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 16 16:21:41.040455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-824c34c4-4858-4982-b664-f7e3eca78dd5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 202 len: 0 microversion: 2.1 time: 0.079403 Nov 16 16:21:41.041069 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 432/977] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:21:40 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:41.049256 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:41.050076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:41.056383 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:41.057051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:41.058145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:41.058659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:41.089014 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1944481325", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1284105524", "security_groups": [{"name": "tempest-secgroup-smoke-251262737"}], "block_device_mapping_v2": [{"uuid": "db8eddda-6a58-4455-a3c6-59ee04e3ba16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8ae9b94e-5cd6-4cea-ac09-979515cf0294"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:41.263145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:41.269002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] validate_networks() for [('8ae9b94e-5cd6-4cea-ac09-979515cf0294', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:21:41.272232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-aef5596a-8c2b-4be9-b702-e377d8d7a8cc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1708 microversion: 2.1 time: 0.226740 Nov 16 16:21:41.272805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 546/978] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:41 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1708 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:41.277354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b1202db1-e327-49e3-a615-1a2e8aa0e3f6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:41.278265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b1202db1-e327-49e3-a615-1a2e8aa0e3f6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:41.284665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b1202db1-e327-49e3-a615-1a2e8aa0e3f6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:41.285117 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b1202db1-e327-49e3-a615-1a2e8aa0e3f6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:41.285904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b1202db1-e327-49e3-a615-1a2e8aa0e3f6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:41.286329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b1202db1-e327-49e3-a615-1a2e8aa0e3f6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:41.384698 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b1202db1-e327-49e3-a615-1a2e8aa0e3f6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 21282 microversion: 2.20 time: 0.110542 Nov 16 16:21:41.385368 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 547/979] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:41 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 21282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:41.877130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:21:41.877673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:21:41.878202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:21:41.878673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:21:41.879080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:21:41.888750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:41.889132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:41.889943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:41.890419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:41.907308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:21:41.911486 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for user bd94e07e5a7d49398e9118053fc13c69 and project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:21:41.967406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:21:41.970899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db8eddda-6a58-4455-a3c6-59ee04e3ba16',volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:21:42.119659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b5149913-e0cd-4f96-b28b-903aa0a40a3b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.035072 Nov 16 16:21:42.120352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 433/980] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:21:41 2021] POST /compute/v2.1/servers => generated 405 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:21:42.131348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-64fc71c7-cf1f-4d2c-a7ff-1606d5fe9f68 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:42.132048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-64fc71c7-cf1f-4d2c-a7ff-1606d5fe9f68 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:42.187566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-64fc71c7-cf1f-4d2c-a7ff-1606d5fe9f68 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:42.194496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-64fc71c7-cf1f-4d2c-a7ff-1606d5fe9f68 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1095 microversion: 2.1 time: 0.067349 Nov 16 16:21:42.195076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 548/981] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:42 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:42.288891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:42.289586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:42.296910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:42.297358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:42.298156 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:42.298595 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:42.398076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e417fe12-e64a-40ce-80e4-1f0cc7d7682c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:42.399112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e417fe12-e64a-40ce-80e4-1f0cc7d7682c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:42.406236 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e417fe12-e64a-40ce-80e4-1f0cc7d7682c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:42.406722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e417fe12-e64a-40ce-80e4-1f0cc7d7682c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:42.407525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e417fe12-e64a-40ce-80e4-1f0cc7d7682c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:42.407955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e417fe12-e64a-40ce-80e4-1f0cc7d7682c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:42.455285 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:42.465718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ea354e83-155e-4d67-9c37-f2ea6c336750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1708 microversion: 2.1 time: 0.180485 Nov 16 16:21:42.466372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 434/982] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:42 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1708 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:42.542645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e417fe12-e64a-40ce-80e4-1f0cc7d7682c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 22978 microversion: 2.20 time: 0.148891 Nov 16 16:21:42.543327 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 549/983] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:42 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 22978 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:43.211966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:43.212632 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:43.219330 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:43.219742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:43.220812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:43.221430 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:43.293082 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:43.301560 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3e8d7789-e7f2-4fa1-8629-e04964f327fb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1201 microversion: 2.1 time: 0.093481 Nov 16 16:21:43.302243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 435/984] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:43 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:43.492495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:43.493204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:43.502353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:43.502928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:43.503757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:43.504201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:43.554742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fefcbdc4-bd8d-497d-9c0b-1442f0fd75e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:43.555864 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fefcbdc4-bd8d-497d-9c0b-1442f0fd75e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:43.561771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fefcbdc4-bd8d-497d-9c0b-1442f0fd75e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:43.562323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fefcbdc4-bd8d-497d-9c0b-1442f0fd75e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:43.563188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fefcbdc4-bd8d-497d-9c0b-1442f0fd75e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:43.563680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fefcbdc4-bd8d-497d-9c0b-1442f0fd75e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:43.642064 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fefcbdc4-bd8d-497d-9c0b-1442f0fd75e7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 23794 microversion: 2.20 time: 0.091126 Nov 16 16:21:43.642822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 436/985] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:43 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 23794 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:43.737624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:43.746643 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-700394b6-d001-4a41-a17c-957dce8fce40 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1712 microversion: 2.1 time: 0.260608 Nov 16 16:21:43.748288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 550/986] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:43 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1712 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:44.320085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:44.321117 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:44.329160 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:44.329856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:44.330612 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:44.331084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:44.589087 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:44.598459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-025b3237-f3dd-47e4-a793-f5922666c721 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.282623 Nov 16 16:21:44.600535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 437/987] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:44 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:44.653560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0e7d9250-c397-4a39-8659-5e4f63b2e2ea tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:44.654600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0e7d9250-c397-4a39-8659-5e4f63b2e2ea tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:44.662890 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e7d9250-c397-4a39-8659-5e4f63b2e2ea tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:44.663345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e7d9250-c397-4a39-8659-5e4f63b2e2ea tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:44.664132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e7d9250-c397-4a39-8659-5e4f63b2e2ea tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:44.664573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0e7d9250-c397-4a39-8659-5e4f63b2e2ea tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:44.745659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0e7d9250-c397-4a39-8659-5e4f63b2e2ea tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 25599 microversion: 2.20 time: 0.095665 Nov 16 16:21:44.748700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 551/988] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:44 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 25599 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:44.753065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-04c5ed2e-b0a8-4e64-9090-5019730b795c req-66a36681-83a4-4359-bdb4-2a88dc7b10a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3ec58d-75c6-423a-a57c-8769a0efd6b0", "tag": "43f0a4a1-31b3-4518-b86e-e8daa712fca4"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:44.755447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:21:44.755447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:21:44.768945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-04c5ed2e-b0a8-4e64-9090-5019730b795c req-66a36681-83a4-4359-bdb4-2a88dc7b10a0 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:44.769492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-04c5ed2e-b0a8-4e64-9090-5019730b795c req-66a36681-83a4-4359-bdb4-2a88dc7b10a0 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:44.781730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-04c5ed2e-b0a8-4e64-9090-5019730b795c req-66a36681-83a4-4359-bdb4-2a88dc7b10a0 service nova] Creating event network-changed:43f0a4a1-31b3-4518-b86e-e8daa712fca4 for instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 on hv-cinder-78776 Nov 16 16:21:44.789173 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-04c5ed2e-b0a8-4e64-9090-5019730b795c req-66a36681-83a4-4359-bdb4-2a88dc7b10a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042741 Nov 16 16:21:44.789889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 438/989] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:21:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:21:45.616789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:45.617580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:45.624912 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:45.625435 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:45.626279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:45.626814 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:45.758004 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ee64db86-1e14-4dfb-9b81-ba55a11d222d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:45.759243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ee64db86-1e14-4dfb-9b81-ba55a11d222d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:45.772389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee64db86-1e14-4dfb-9b81-ba55a11d222d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:45.772830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee64db86-1e14-4dfb-9b81-ba55a11d222d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:45.773611 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee64db86-1e14-4dfb-9b81-ba55a11d222d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:45.774034 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ee64db86-1e14-4dfb-9b81-ba55a11d222d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:45.839829 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:45.847799 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fe9d5933-e10d-484d-b6fd-016a9bb2723c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.235533 Nov 16 16:21:45.848366 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 552/990] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:45 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:45.861697 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ee64db86-1e14-4dfb-9b81-ba55a11d222d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 26942 microversion: 2.20 time: 0.107753 Nov 16 16:21:45.862348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 439/991] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:45 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 26942 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:21:46.869056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:46.869897 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:46.877613 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1e97e6a3-575b-473c-9ea5-8464ea16f4ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:46.880214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1e97e6a3-575b-473c-9ea5-8464ea16f4ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:46.880770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:46.881190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:46.881995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:46.882419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:46.887951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e97e6a3-575b-473c-9ea5-8464ea16f4ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:46.888396 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e97e6a3-575b-473c-9ea5-8464ea16f4ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:46.889181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e97e6a3-575b-473c-9ea5-8464ea16f4ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:46.889614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e97e6a3-575b-473c-9ea5-8464ea16f4ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:46.975924 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1e97e6a3-575b-473c-9ea5-8464ea16f4ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 27663 microversion: 2.20 time: 0.104828 Nov 16 16:21:46.976487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 440/992] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:46 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 27663 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:47.041881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:47.053277 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5f79d183-40e0-484f-99b3-ce9332f2ef95 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.190206 Nov 16 16:21:47.053844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 553/993] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:46 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:47.992095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eff51098-e441-409e-825d-7e38b5248304 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:47.993071 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eff51098-e441-409e-825d-7e38b5248304 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:48.000262 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eff51098-e441-409e-825d-7e38b5248304 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:48.000701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eff51098-e441-409e-825d-7e38b5248304 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:48.001468 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eff51098-e441-409e-825d-7e38b5248304 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:48.001894 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eff51098-e441-409e-825d-7e38b5248304 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:48.076047 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:48.076639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:48.082911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eff51098-e441-409e-825d-7e38b5248304 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 27899 microversion: 2.20 time: 0.096581 Nov 16 16:21:48.083554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:48.083715 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 441/994] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:47 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 27899 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:48.084098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:48.085048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:48.085509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:48.226023 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:48.233954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-71444487-46a1-46cb-8747-59f7f930dce9 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.161735 Nov 16 16:21:48.234550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 554/995] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:48 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:49.100261 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2659d5da-bb76-428a-9ad2-5b5ed1bf1f96 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:49.101977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2659d5da-bb76-428a-9ad2-5b5ed1bf1f96 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:49.113678 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2659d5da-bb76-428a-9ad2-5b5ed1bf1f96 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:49.114435 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2659d5da-bb76-428a-9ad2-5b5ed1bf1f96 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:49.115716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2659d5da-bb76-428a-9ad2-5b5ed1bf1f96 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:49.116144 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2659d5da-bb76-428a-9ad2-5b5ed1bf1f96 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:49.200747 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2659d5da-bb76-428a-9ad2-5b5ed1bf1f96 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.107029 Nov 16 16:21:49.201607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 442/996] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:49 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:49.259370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:49.260399 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:49.271917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:49.272499 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:49.273286 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:49.273718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:49.436366 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:49.445935 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-50770506-e066-4d4e-afcf-d62000a3fde5 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.192978 Nov 16 16:21:49.446509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 555/997] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:49 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:50.218223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fe368735-b2c2-4751-ba41-6fe808f7b54c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:50.219685 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fe368735-b2c2-4751-ba41-6fe808f7b54c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:50.228581 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe368735-b2c2-4751-ba41-6fe808f7b54c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:50.229027 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe368735-b2c2-4751-ba41-6fe808f7b54c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:50.229811 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe368735-b2c2-4751-ba41-6fe808f7b54c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:50.230243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe368735-b2c2-4751-ba41-6fe808f7b54c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:50.292616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fe368735-b2c2-4751-ba41-6fe808f7b54c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.080156 Nov 16 16:21:50.293235 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 443/998] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:50 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:50.470946 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:50.471624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:50.480477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:50.481068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:50.482087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:50.482707 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:50.629134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:50.639827 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ec712935-1490-44a2-964a-65ba4fada41c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.173997 Nov 16 16:21:50.640685 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 556/999] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:50 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:51.310356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0d217c39-1ce5-4772-9c54-acca6069d5e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:51.312022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0d217c39-1ce5-4772-9c54-acca6069d5e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:51.323566 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d217c39-1ce5-4772-9c54-acca6069d5e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:51.324304 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d217c39-1ce5-4772-9c54-acca6069d5e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:51.325588 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d217c39-1ce5-4772-9c54-acca6069d5e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:51.326307 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d217c39-1ce5-4772-9c54-acca6069d5e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:51.397346 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0d217c39-1ce5-4772-9c54-acca6069d5e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.094464 Nov 16 16:21:51.397988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 444/1000] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:51 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:51.660471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:51.661137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:51.668982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:51.669458 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:51.670254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:51.670742 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:51.806713 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:51.814217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8e3df328-8494-44ea-be53-1f13ec4adf1b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.158646 Nov 16 16:21:51.814817 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 557/1001] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:51 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:52.410117 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fe927e6c-5ccb-45f6-9c4b-2e6f8faac60b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:52.411138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fe927e6c-5ccb-45f6-9c4b-2e6f8faac60b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:52.418766 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe927e6c-5ccb-45f6-9c4b-2e6f8faac60b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:52.419190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe927e6c-5ccb-45f6-9c4b-2e6f8faac60b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:52.419991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe927e6c-5ccb-45f6-9c4b-2e6f8faac60b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:52.420417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fe927e6c-5ccb-45f6-9c4b-2e6f8faac60b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:52.506840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fe927e6c-5ccb-45f6-9c4b-2e6f8faac60b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.100694 Nov 16 16:21:52.507466 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 445/1002] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:52 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:52.833630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:52.834593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:52.841542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:52.841989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:52.842796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:52.843222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:53.002447 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:53.013610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f062306f-7e33-4b53-8e5a-975f0ecdd2b6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.185227 Nov 16 16:21:53.014485 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 558/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:52 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:53.524421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-87a09f04-5c47-4894-a2e9-22eebf3007f3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:53.526078 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-87a09f04-5c47-4894-a2e9-22eebf3007f3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:53.537692 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87a09f04-5c47-4894-a2e9-22eebf3007f3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:53.538536 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87a09f04-5c47-4894-a2e9-22eebf3007f3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:53.539348 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87a09f04-5c47-4894-a2e9-22eebf3007f3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:53.539808 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87a09f04-5c47-4894-a2e9-22eebf3007f3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:53.608051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-87a09f04-5c47-4894-a2e9-22eebf3007f3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.090802 Nov 16 16:21:53.608714 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 446/1004] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:53 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:54.035430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:54.036220 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:54.044319 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:54.044873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:54.045821 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:54.046351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:54.193538 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:54.202077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-47fdb664-2950-4bc8-881f-2838554767b8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.171350 Nov 16 16:21:54.202663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 559/1005] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:54 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:54.621648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8e3f9d68-1199-4ce3-a73f-0a3f449e07e3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:54.622705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8e3f9d68-1199-4ce3-a73f-0a3f449e07e3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:54.630048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8e3f9d68-1199-4ce3-a73f-0a3f449e07e3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:54.630542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8e3f9d68-1199-4ce3-a73f-0a3f449e07e3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:54.631330 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8e3f9d68-1199-4ce3-a73f-0a3f449e07e3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:54.631750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8e3f9d68-1199-4ce3-a73f-0a3f449e07e3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:54.695967 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8e3f9d68-1199-4ce3-a73f-0a3f449e07e3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.078298 Nov 16 16:21:54.696593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 447/1006] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:54 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:55.220451 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:55.221056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:55.228699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:55.232434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:55.234190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:55.235745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:55.392273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:55.400471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-71ae41bf-e05e-4ced-9485-a12fb6b42c5a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.183820 Nov 16 16:21:55.401033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 560/1007] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:55 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:55.708804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-780c2bc8-5471-473b-be81-648f5613ec33 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:55.709708 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-780c2bc8-5471-473b-be81-648f5613ec33 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:55.717151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-780c2bc8-5471-473b-be81-648f5613ec33 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:55.717599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-780c2bc8-5471-473b-be81-648f5613ec33 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:55.718365 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-780c2bc8-5471-473b-be81-648f5613ec33 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:55.718824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-780c2bc8-5471-473b-be81-648f5613ec33 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:55.815331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-780c2bc8-5471-473b-be81-648f5613ec33 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.110207 Nov 16 16:21:55.816368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 448/1008] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:55 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:56.419128 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:56.419752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:56.426700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:56.427146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:56.427920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:56.428356 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:56.579542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:56.587928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-31decd8d-ad37-4676-8e10-21e400223924 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.173722 Nov 16 16:21:56.590769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 561/1009] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:56 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:56.774933 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-09e32d45-5602-49d6-8070-d150c0322c34 req-b42a9257-cddb-40de-876f-546da492952e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3ec58d-75c6-423a-a57c-8769a0efd6b0", "name": "network-vif-plugged", "status": "completed", "tag": "43f0a4a1-31b3-4518-b86e-e8daa712fca4"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:56.776648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:21:56.776648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:21:56.787008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-09e32d45-5602-49d6-8070-d150c0322c34 req-b42a9257-cddb-40de-876f-546da492952e service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:56.787008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-09e32d45-5602-49d6-8070-d150c0322c34 req-b42a9257-cddb-40de-876f-546da492952e service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:56.798738 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-09e32d45-5602-49d6-8070-d150c0322c34 req-b42a9257-cddb-40de-876f-546da492952e service nova] Creating event network-vif-plugged:43f0a4a1-31b3-4518-b86e-e8daa712fca4 for instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 on hv-cinder-78776 Nov 16 16:21:56.803588 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-09e32d45-5602-49d6-8070-d150c0322c34 req-b42a9257-cddb-40de-876f-546da492952e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033130 Nov 16 16:21:56.804218 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 449/1010] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:21:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:21:56.829420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-38698e25-f6f1-4c51-bead-5e80b3afb922 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:56.830739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-38698e25-f6f1-4c51-bead-5e80b3afb922 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:56.836745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38698e25-f6f1-4c51-bead-5e80b3afb922 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:56.837173 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38698e25-f6f1-4c51-bead-5e80b3afb922 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:56.838064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38698e25-f6f1-4c51-bead-5e80b3afb922 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:56.838563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-38698e25-f6f1-4c51-bead-5e80b3afb922 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:56.912688 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-38698e25-f6f1-4c51-bead-5e80b3afb922 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.086414 Nov 16 16:21:56.913506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 562/1011] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:56 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:57.619450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:57.620485 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:57.627923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:57.628372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:57.629152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:57.629596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:57.787312 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:57.795599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bc026711-6aef-4f27-bef9-5959fbbd98b1 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1266 microversion: 2.1 time: 0.182968 Nov 16 16:21:57.796134 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 450/1012] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:57 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:57.930835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-912a993e-b8ea-4c83-aefe-708747c1ae48 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:57.932385 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-912a993e-b8ea-4c83-aefe-708747c1ae48 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:57.943871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-912a993e-b8ea-4c83-aefe-708747c1ae48 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:57.944606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-912a993e-b8ea-4c83-aefe-708747c1ae48 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:57.945886 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-912a993e-b8ea-4c83-aefe-708747c1ae48 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:57.946623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-912a993e-b8ea-4c83-aefe-708747c1ae48 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:58.037245 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-912a993e-b8ea-4c83-aefe-708747c1ae48 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.112710 Nov 16 16:21:58.038275 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 563/1013] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:57 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:58.816457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:58.817407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:58.826057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:58.826541 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:58.827323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:58.827761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:58.973284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:58.985383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0be2d534-aef5-4cf6-bc45-fa4824818981 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1451 microversion: 2.1 time: 0.174414 Nov 16 16:21:58.986207 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 451/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:58 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:21:59.005910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:21:59.006679 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:59.014035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:59.014512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:59.015665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:59.016093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:59.050829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0411bbf3-0540-4d30-b5d7-9227fcdc8010 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:21:59.051769 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0411bbf3-0540-4d30-b5d7-9227fcdc8010 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:21:59.058137 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0411bbf3-0540-4d30-b5d7-9227fcdc8010 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:59.058623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0411bbf3-0540-4d30-b5d7-9227fcdc8010 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:59.059403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0411bbf3-0540-4d30-b5d7-9227fcdc8010 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:21:59.059841 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0411bbf3-0540-4d30-b5d7-9227fcdc8010 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:21:59.131104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0411bbf3-0540-4d30-b5d7-9227fcdc8010 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.083501 Nov 16 16:21:59.131772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 452/1015] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:21:59 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:21:59.167221 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:21:59.178755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5afcc8a8-2b42-452c-8346-c6cb7d69cf92 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1451 microversion: 2.1 time: 0.176566 Nov 16 16:21:59.179434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 564/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:21:59 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:00.143477 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e38e9972-acc7-47e9-8962-1b5545bc8c85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:00.144483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e38e9972-acc7-47e9-8962-1b5545bc8c85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:00.152084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e38e9972-acc7-47e9-8962-1b5545bc8c85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:00.152618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e38e9972-acc7-47e9-8962-1b5545bc8c85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:00.153425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e38e9972-acc7-47e9-8962-1b5545bc8c85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:00.153838 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e38e9972-acc7-47e9-8962-1b5545bc8c85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:00.222814 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e38e9972-acc7-47e9-8962-1b5545bc8c85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.083152 Nov 16 16:22:00.223734 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 453/1017] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:00 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:01.097147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-c890ec8e-c928-4551-8b5c-d723e7921eed req-01c0d017-bdc7-479a-a40b-f7ba75566a38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f3ec58d-75c6-423a-a57c-8769a0efd6b0", "tag": "43f0a4a1-31b3-4518-b86e-e8daa712fca4"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:01.098673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:22:01.098673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:22:01.107313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-c890ec8e-c928-4551-8b5c-d723e7921eed req-01c0d017-bdc7-479a-a40b-f7ba75566a38 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:01.107737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-c890ec8e-c928-4551-8b5c-d723e7921eed req-01c0d017-bdc7-479a-a40b-f7ba75566a38 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:01.118893 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-c890ec8e-c928-4551-8b5c-d723e7921eed req-01c0d017-bdc7-479a-a40b-f7ba75566a38 service nova] Creating event network-changed:43f0a4a1-31b3-4518-b86e-e8daa712fca4 for instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 on hv-cinder-78776 Nov 16 16:22:01.123708 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-c890ec8e-c928-4551-8b5c-d723e7921eed req-01c0d017-bdc7-479a-a40b-f7ba75566a38 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030304 Nov 16 16:22:01.124361 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 565/1018] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:22:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:22:01.236374 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7fd3a30f-16dc-4eee-85da-2ac381c57de3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:01.237518 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7fd3a30f-16dc-4eee-85da-2ac381c57de3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:01.245171 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fd3a30f-16dc-4eee-85da-2ac381c57de3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:01.245610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fd3a30f-16dc-4eee-85da-2ac381c57de3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:01.246679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fd3a30f-16dc-4eee-85da-2ac381c57de3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:01.247111 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7fd3a30f-16dc-4eee-85da-2ac381c57de3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:01.312995 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7fd3a30f-16dc-4eee-85da-2ac381c57de3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28209 microversion: 2.20 time: 0.080656 Nov 16 16:22:01.313687 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 454/1019] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:01 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:02.326672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-aba316af-061f-4adf-85f8-14ce2f1248be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:02.327727 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-aba316af-061f-4adf-85f8-14ce2f1248be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:02.335566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba316af-061f-4adf-85f8-14ce2f1248be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:02.336138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba316af-061f-4adf-85f8-14ce2f1248be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:02.337249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba316af-061f-4adf-85f8-14ce2f1248be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:02.337703 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba316af-061f-4adf-85f8-14ce2f1248be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:02.419584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-aba316af-061f-4adf-85f8-14ce2f1248be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28500 microversion: 2.20 time: 0.097673 Nov 16 16:22:02.420157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 566/1020] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:02 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28500 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:03.436467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f05e2591-c5fa-4870-ad78-35a9924a49af tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:03.437889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f05e2591-c5fa-4870-ad78-35a9924a49af tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:03.448003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f05e2591-c5fa-4870-ad78-35a9924a49af tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:03.448564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f05e2591-c5fa-4870-ad78-35a9924a49af tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:03.449357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f05e2591-c5fa-4870-ad78-35a9924a49af tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:03.449790 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f05e2591-c5fa-4870-ad78-35a9924a49af tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:03.525446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f05e2591-c5fa-4870-ad78-35a9924a49af tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28500 microversion: 2.20 time: 0.094420 Nov 16 16:22:03.526682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 455/1021] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:03 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28500 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:04.542438 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bd4d98b7-9ba3-4287-8280-a8c9a76ae224 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:04.544075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bd4d98b7-9ba3-4287-8280-a8c9a76ae224 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:04.555634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd4d98b7-9ba3-4287-8280-a8c9a76ae224 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:04.556415 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd4d98b7-9ba3-4287-8280-a8c9a76ae224 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:04.557678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd4d98b7-9ba3-4287-8280-a8c9a76ae224 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:04.558342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bd4d98b7-9ba3-4287-8280-a8c9a76ae224 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:04.647471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bd4d98b7-9ba3-4287-8280-a8c9a76ae224 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.111778 Nov 16 16:22:04.648278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 567/1022] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:04 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:05.664979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9897234a-9406-4384-b879-ba29f2e3c98f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:05.665886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9897234a-9406-4384-b879-ba29f2e3c98f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:05.675310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9897234a-9406-4384-b879-ba29f2e3c98f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:05.675781 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9897234a-9406-4384-b879-ba29f2e3c98f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:05.676799 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9897234a-9406-4384-b879-ba29f2e3c98f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:05.677542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9897234a-9406-4384-b879-ba29f2e3c98f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:05.750178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9897234a-9406-4384-b879-ba29f2e3c98f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.091529 Nov 16 16:22:05.750897 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 456/1023] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:05 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:06.767292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-04f85c2b-451a-4dff-b93d-fd4b7bca9a6a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:06.768315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-04f85c2b-451a-4dff-b93d-fd4b7bca9a6a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:06.775400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-04f85c2b-451a-4dff-b93d-fd4b7bca9a6a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:06.775843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-04f85c2b-451a-4dff-b93d-fd4b7bca9a6a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:06.776613 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-04f85c2b-451a-4dff-b93d-fd4b7bca9a6a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:06.777091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-04f85c2b-451a-4dff-b93d-fd4b7bca9a6a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:06.852909 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-04f85c2b-451a-4dff-b93d-fd4b7bca9a6a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.091339 Nov 16 16:22:06.853558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 568/1024] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:06 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:07.866100 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d5bb1ad6-8610-44e3-81ec-4d17d35a2ccf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:07.867166 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d5bb1ad6-8610-44e3-81ec-4d17d35a2ccf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:07.874435 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5bb1ad6-8610-44e3-81ec-4d17d35a2ccf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:07.874993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5bb1ad6-8610-44e3-81ec-4d17d35a2ccf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:07.875800 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5bb1ad6-8610-44e3-81ec-4d17d35a2ccf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:07.876236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d5bb1ad6-8610-44e3-81ec-4d17d35a2ccf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:07.944773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d5bb1ad6-8610-44e3-81ec-4d17d35a2ccf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.082316 Nov 16 16:22:07.945777 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 457/1025] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:07 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:08.964105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-62cb800d-92f3-49af-80cf-51a83bd77159 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:08.965583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-62cb800d-92f3-49af-80cf-51a83bd77159 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:08.977224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62cb800d-92f3-49af-80cf-51a83bd77159 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:08.977961 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62cb800d-92f3-49af-80cf-51a83bd77159 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:08.979290 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62cb800d-92f3-49af-80cf-51a83bd77159 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:08.980000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62cb800d-92f3-49af-80cf-51a83bd77159 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:09.043678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-62cb800d-92f3-49af-80cf-51a83bd77159 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.086575 Nov 16 16:22:09.044289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 569/1026] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:08 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:10.060399 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3c428f61-99a3-46a6-819b-259a4adba5ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:10.061638 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3c428f61-99a3-46a6-819b-259a4adba5ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:10.069515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c428f61-99a3-46a6-819b-259a4adba5ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:10.069958 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c428f61-99a3-46a6-819b-259a4adba5ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:10.070764 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c428f61-99a3-46a6-819b-259a4adba5ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:10.071194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3c428f61-99a3-46a6-819b-259a4adba5ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:10.144547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3c428f61-99a3-46a6-819b-259a4adba5ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.088667 Nov 16 16:22:10.145425 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 458/1027] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:10 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:11.160947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5f6202ec-ad62-4300-8a6b-9c2e6c97bd75 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:11.161963 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5f6202ec-ad62-4300-8a6b-9c2e6c97bd75 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:11.169271 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f6202ec-ad62-4300-8a6b-9c2e6c97bd75 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:11.169715 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f6202ec-ad62-4300-8a6b-9c2e6c97bd75 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:11.170547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f6202ec-ad62-4300-8a6b-9c2e6c97bd75 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:11.170981 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f6202ec-ad62-4300-8a6b-9c2e6c97bd75 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:11.232660 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5f6202ec-ad62-4300-8a6b-9c2e6c97bd75 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.076853 Nov 16 16:22:11.233328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 570/1028] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:11 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:11.455883 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:22:11.456632 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: Tue Nov 16 16:22:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:22:12.249993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-69ee6254-99f3-4b53-ae58-9a7ac771a37e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:12.251723 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-69ee6254-99f3-4b53-ae58-9a7ac771a37e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:12.263538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69ee6254-99f3-4b53-ae58-9a7ac771a37e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:12.264285 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69ee6254-99f3-4b53-ae58-9a7ac771a37e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:12.265945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69ee6254-99f3-4b53-ae58-9a7ac771a37e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:12.266654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69ee6254-99f3-4b53-ae58-9a7ac771a37e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:12.337513 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-69ee6254-99f3-4b53-ae58-9a7ac771a37e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.094229 Nov 16 16:22:12.338546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 459/1029] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:12 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:13.357109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6d13b19a-d86c-4df8-bb14-f94cf135ce04 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:13.358908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6d13b19a-d86c-4df8-bb14-f94cf135ce04 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:13.371036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d13b19a-d86c-4df8-bb14-f94cf135ce04 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:13.371782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d13b19a-d86c-4df8-bb14-f94cf135ce04 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:13.373068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d13b19a-d86c-4df8-bb14-f94cf135ce04 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:13.373796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6d13b19a-d86c-4df8-bb14-f94cf135ce04 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:13.441464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6d13b19a-d86c-4df8-bb14-f94cf135ce04 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.091020 Nov 16 16:22:13.442131 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 571/1030] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:13 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:14.456457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-94b14896-d84c-4226-a162-8e98d1c16c4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:14.457438 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-94b14896-d84c-4226-a162-8e98d1c16c4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:14.464700 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94b14896-d84c-4226-a162-8e98d1c16c4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:14.465138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94b14896-d84c-4226-a162-8e98d1c16c4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:14.465898 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94b14896-d84c-4226-a162-8e98d1c16c4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:14.466323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-94b14896-d84c-4226-a162-8e98d1c16c4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:14.533979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-94b14896-d84c-4226-a162-8e98d1c16c4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.082232 Nov 16 16:22:14.534899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 460/1031] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:14 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:15.552001 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f061cb48-3e75-4ddf-998c-a22f193276da tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:15.553605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f061cb48-3e75-4ddf-998c-a22f193276da tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:15.564375 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f061cb48-3e75-4ddf-998c-a22f193276da tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:15.564819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f061cb48-3e75-4ddf-998c-a22f193276da tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:15.565589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f061cb48-3e75-4ddf-998c-a22f193276da tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:15.566011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f061cb48-3e75-4ddf-998c-a22f193276da tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:15.628777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f061cb48-3e75-4ddf-998c-a22f193276da tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.083725 Nov 16 16:22:15.629427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 572/1032] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:15 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:16.645061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9e2926dd-5e2a-4d92-8c09-0250f1604f2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:16.645984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9e2926dd-5e2a-4d92-8c09-0250f1604f2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:16.653459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e2926dd-5e2a-4d92-8c09-0250f1604f2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:16.653910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e2926dd-5e2a-4d92-8c09-0250f1604f2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:16.654728 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e2926dd-5e2a-4d92-8c09-0250f1604f2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:16.655216 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9e2926dd-5e2a-4d92-8c09-0250f1604f2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:16.722946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9e2926dd-5e2a-4d92-8c09-0250f1604f2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.083731 Nov 16 16:22:16.723575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 461/1033] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:16 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:17.740065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f74b527a-5385-497b-b41a-f73b78bc0969 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:17.741611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f74b527a-5385-497b-b41a-f73b78bc0969 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:17.752730 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f74b527a-5385-497b-b41a-f73b78bc0969 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:17.753234 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f74b527a-5385-497b-b41a-f73b78bc0969 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:17.754197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f74b527a-5385-497b-b41a-f73b78bc0969 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:17.754715 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f74b527a-5385-497b-b41a-f73b78bc0969 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:17.821702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f74b527a-5385-497b-b41a-f73b78bc0969 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.088238 Nov 16 16:22:17.822716 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 573/1034] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:17 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:18.836557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c3478ce1-5170-4b05-87d7-474f012b9fbf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:18.837570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c3478ce1-5170-4b05-87d7-474f012b9fbf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:18.844693 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3478ce1-5170-4b05-87d7-474f012b9fbf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:18.845258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3478ce1-5170-4b05-87d7-474f012b9fbf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:18.845906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3478ce1-5170-4b05-87d7-474f012b9fbf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:18.846312 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c3478ce1-5170-4b05-87d7-474f012b9fbf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:18.923193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c3478ce1-5170-4b05-87d7-474f012b9fbf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.090418 Nov 16 16:22:18.923745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 462/1035] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:18 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:19.938913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fc9cd1b8-1660-4643-b373-578930da8cd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:19.940019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fc9cd1b8-1660-4643-b373-578930da8cd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:19.948533 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9cd1b8-1660-4643-b373-578930da8cd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:19.948976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9cd1b8-1660-4643-b373-578930da8cd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:19.949746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9cd1b8-1660-4643-b373-578930da8cd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:19.950171 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fc9cd1b8-1660-4643-b373-578930da8cd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:20.023649 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fc9cd1b8-1660-4643-b373-578930da8cd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.090806 Nov 16 16:22:20.024644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 574/1036] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:19 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:21.040646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3af99990-aaf6-41d6-846f-bf26a36b376a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:21.042142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3af99990-aaf6-41d6-846f-bf26a36b376a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:21.051461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3af99990-aaf6-41d6-846f-bf26a36b376a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:21.051931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3af99990-aaf6-41d6-846f-bf26a36b376a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:21.052721 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3af99990-aaf6-41d6-846f-bf26a36b376a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:21.053140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3af99990-aaf6-41d6-846f-bf26a36b376a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:21.120480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3af99990-aaf6-41d6-846f-bf26a36b376a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.086828 Nov 16 16:22:21.121118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 463/1037] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:21 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:22.137892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2326a5d1-ec19-4a59-8d70-76dd3766a89b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:22.139913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2326a5d1-ec19-4a59-8d70-76dd3766a89b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:22.151434 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2326a5d1-ec19-4a59-8d70-76dd3766a89b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:22.152155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2326a5d1-ec19-4a59-8d70-76dd3766a89b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:22.153423 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2326a5d1-ec19-4a59-8d70-76dd3766a89b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:22.154141 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2326a5d1-ec19-4a59-8d70-76dd3766a89b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:22.220411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2326a5d1-ec19-4a59-8d70-76dd3766a89b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.089100 Nov 16 16:22:22.221056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 575/1038] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:22 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:23.237732 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0d54a8e8-dacf-4df6-8411-17c61e1b8f9b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:23.238791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0d54a8e8-dacf-4df6-8411-17c61e1b8f9b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:23.246082 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d54a8e8-dacf-4df6-8411-17c61e1b8f9b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:23.246568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d54a8e8-dacf-4df6-8411-17c61e1b8f9b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:23.247407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d54a8e8-dacf-4df6-8411-17c61e1b8f9b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:23.247812 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0d54a8e8-dacf-4df6-8411-17c61e1b8f9b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:23.322338 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0d54a8e8-dacf-4df6-8411-17c61e1b8f9b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.092679 Nov 16 16:22:23.323024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 464/1039] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:23 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:24.335701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ca97e5f8-51b3-4dfd-8139-652d979cf942 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:24.336866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ca97e5f8-51b3-4dfd-8139-652d979cf942 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:24.344111 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca97e5f8-51b3-4dfd-8139-652d979cf942 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:24.344607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca97e5f8-51b3-4dfd-8139-652d979cf942 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:24.345409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca97e5f8-51b3-4dfd-8139-652d979cf942 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:24.345965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ca97e5f8-51b3-4dfd-8139-652d979cf942 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:24.410793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ca97e5f8-51b3-4dfd-8139-652d979cf942 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.079431 Nov 16 16:22:24.411664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 576/1040] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:24 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:25.423684 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7e228b17-b454-454e-9150-97d355ea4e3c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:25.424701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7e228b17-b454-454e-9150-97d355ea4e3c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:25.431837 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e228b17-b454-454e-9150-97d355ea4e3c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:25.432279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e228b17-b454-454e-9150-97d355ea4e3c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:25.433055 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e228b17-b454-454e-9150-97d355ea4e3c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:25.433483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e228b17-b454-454e-9150-97d355ea4e3c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:25.495501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7e228b17-b454-454e-9150-97d355ea4e3c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.075819 Nov 16 16:22:25.496086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 465/1041] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:25 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:26.512752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-67cd35a9-b45e-4d5b-929a-8081ad2f4692 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:26.514817 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-67cd35a9-b45e-4d5b-929a-8081ad2f4692 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:26.526799 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67cd35a9-b45e-4d5b-929a-8081ad2f4692 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:26.527554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67cd35a9-b45e-4d5b-929a-8081ad2f4692 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:26.528844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67cd35a9-b45e-4d5b-929a-8081ad2f4692 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:26.529565 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67cd35a9-b45e-4d5b-929a-8081ad2f4692 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:26.594594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-67cd35a9-b45e-4d5b-929a-8081ad2f4692 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.088698 Nov 16 16:22:26.595205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 577/1042] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:26 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:27.611669 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-99021b15-326a-40f5-9c50-26d014518246 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:27.613369 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-99021b15-326a-40f5-9c50-26d014518246 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:27.623588 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99021b15-326a-40f5-9c50-26d014518246 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:27.624094 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99021b15-326a-40f5-9c50-26d014518246 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:27.625207 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99021b15-326a-40f5-9c50-26d014518246 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:27.625843 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99021b15-326a-40f5-9c50-26d014518246 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:27.693852 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-99021b15-326a-40f5-9c50-26d014518246 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.089071 Nov 16 16:22:27.694405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 466/1043] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:27 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:28.708214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c451eeeb-27ff-4ad0-95c6-71d00c62dfd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:28.709213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c451eeeb-27ff-4ad0-95c6-71d00c62dfd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:28.716584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c451eeeb-27ff-4ad0-95c6-71d00c62dfd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:28.717037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c451eeeb-27ff-4ad0-95c6-71d00c62dfd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:28.717810 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c451eeeb-27ff-4ad0-95c6-71d00c62dfd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:28.718238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c451eeeb-27ff-4ad0-95c6-71d00c62dfd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:28.794609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c451eeeb-27ff-4ad0-95c6-71d00c62dfd7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.091257 Nov 16 16:22:28.795502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 578/1044] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:28 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:29.811201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e6cad226-f988-4d22-9d23-aea6b9df5351 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:29.812505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e6cad226-f988-4d22-9d23-aea6b9df5351 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:29.820689 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6cad226-f988-4d22-9d23-aea6b9df5351 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:29.821128 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6cad226-f988-4d22-9d23-aea6b9df5351 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:29.821919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6cad226-f988-4d22-9d23-aea6b9df5351 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:29.822351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e6cad226-f988-4d22-9d23-aea6b9df5351 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:29.883695 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e6cad226-f988-4d22-9d23-aea6b9df5351 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.077919 Nov 16 16:22:29.884340 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 467/1045] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:29 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:30.897002 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-77337fbc-909b-4fbf-82c7-566c0f727b2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:30.898003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-77337fbc-909b-4fbf-82c7-566c0f727b2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:30.905246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77337fbc-909b-4fbf-82c7-566c0f727b2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:30.905691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77337fbc-909b-4fbf-82c7-566c0f727b2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:30.906491 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77337fbc-909b-4fbf-82c7-566c0f727b2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:30.906925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-77337fbc-909b-4fbf-82c7-566c0f727b2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:30.970352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-77337fbc-909b-4fbf-82c7-566c0f727b2c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.077399 Nov 16 16:22:30.970910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 579/1046] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:30 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:31.987600 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0068087d-cab9-48bc-8fcf-759674d53a57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:31.989325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0068087d-cab9-48bc-8fcf-759674d53a57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:32.000707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0068087d-cab9-48bc-8fcf-759674d53a57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:32.001451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0068087d-cab9-48bc-8fcf-759674d53a57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:32.002779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0068087d-cab9-48bc-8fcf-759674d53a57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:32.003498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0068087d-cab9-48bc-8fcf-759674d53a57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:32.080975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0068087d-cab9-48bc-8fcf-759674d53a57 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.100328 Nov 16 16:22:32.081614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 468/1047] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:31 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:22:33.096210 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-06a40469-fe04-40b0-8659-0ac8b2b5a67f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:33.097311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-06a40469-fe04-40b0-8659-0ac8b2b5a67f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:33.105314 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06a40469-fe04-40b0-8659-0ac8b2b5a67f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:33.105807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06a40469-fe04-40b0-8659-0ac8b2b5a67f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:33.106692 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06a40469-fe04-40b0-8659-0ac8b2b5a67f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:33.107163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06a40469-fe04-40b0-8659-0ac8b2b5a67f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:33.175985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-06a40469-fe04-40b0-8659-0ac8b2b5a67f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.083595 Nov 16 16:22:33.176890 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 580/1048] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:33 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:22:34.195041 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c2663a80-4619-418b-aeac-c0f8767e3975 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:34.196181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c2663a80-4619-418b-aeac-c0f8767e3975 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:34.203291 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2663a80-4619-418b-aeac-c0f8767e3975 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:34.203663 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2663a80-4619-418b-aeac-c0f8767e3975 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:34.204426 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2663a80-4619-418b-aeac-c0f8767e3975 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:34.204846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2663a80-4619-418b-aeac-c0f8767e3975 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:34.272045 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c2663a80-4619-418b-aeac-c0f8767e3975 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 28668 microversion: 2.20 time: 0.083453 Nov 16 16:22:34.272910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 469/1049] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:34 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 28668 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:35.285321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-51881c30-31d4-4d05-a099-771e511194be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:35.286506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-51881c30-31d4-4d05-a099-771e511194be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:35.294672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51881c30-31d4-4d05-a099-771e511194be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:35.295116 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51881c30-31d4-4d05-a099-771e511194be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:35.295936 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51881c30-31d4-4d05-a099-771e511194be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:35.296368 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51881c30-31d4-4d05-a099-771e511194be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:35.376295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-51881c30-31d4-4d05-a099-771e511194be tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 29398 microversion: 2.20 time: 0.094880 Nov 16 16:22:35.377297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 581/1050] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:35 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 29398 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:36.392806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d9e764ec-d8ac-47ad-a72f-41299a41ffa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:36.394120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d9e764ec-d8ac-47ad-a72f-41299a41ffa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:36.404855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9e764ec-d8ac-47ad-a72f-41299a41ffa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:36.405464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9e764ec-d8ac-47ad-a72f-41299a41ffa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:36.406837 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9e764ec-d8ac-47ad-a72f-41299a41ffa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:36.407577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d9e764ec-d8ac-47ad-a72f-41299a41ffa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:36.506504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d9e764ec-d8ac-47ad-a72f-41299a41ffa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 31386 microversion: 2.20 time: 0.120545 Nov 16 16:22:36.507427 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 470/1051] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:36 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 31386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:37.524208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-146d0a9a-27d1-4af7-99b9-69dccb59580f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:37.525242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-146d0a9a-27d1-4af7-99b9-69dccb59580f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:37.532833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-146d0a9a-27d1-4af7-99b9-69dccb59580f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:37.533300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-146d0a9a-27d1-4af7-99b9-69dccb59580f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:37.534109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-146d0a9a-27d1-4af7-99b9-69dccb59580f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:37.534607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-146d0a9a-27d1-4af7-99b9-69dccb59580f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:37.612873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-146d0a9a-27d1-4af7-99b9-69dccb59580f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 33058 microversion: 2.20 time: 0.095119 Nov 16 16:22:37.613526 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 582/1052] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:37 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 33058 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:38.627701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-14e50d4e-6c51-42de-b6cd-cb3c7bad023e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:38.628730 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-14e50d4e-6c51-42de-b6cd-cb3c7bad023e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:38.636461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14e50d4e-6c51-42de-b6cd-cb3c7bad023e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:38.636842 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14e50d4e-6c51-42de-b6cd-cb3c7bad023e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:38.637610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14e50d4e-6c51-42de-b6cd-cb3c7bad023e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:38.638042 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14e50d4e-6c51-42de-b6cd-cb3c7bad023e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:38.711030 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-14e50d4e-6c51-42de-b6cd-cb3c7bad023e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 34033 microversion: 2.20 time: 0.087271 Nov 16 16:22:38.711701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 471/1053] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:38 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 34033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:39.727693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-76d60bf8-a6fd-434c-a951-4d99b0a4e423 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:39.728737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-76d60bf8-a6fd-434c-a951-4d99b0a4e423 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:39.736427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76d60bf8-a6fd-434c-a951-4d99b0a4e423 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:39.736904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76d60bf8-a6fd-434c-a951-4d99b0a4e423 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:39.737723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76d60bf8-a6fd-434c-a951-4d99b0a4e423 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:39.738176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76d60bf8-a6fd-434c-a951-4d99b0a4e423 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:39.818038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-76d60bf8-a6fd-434c-a951-4d99b0a4e423 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 35206 microversion: 2.20 time: 0.096774 Nov 16 16:22:39.819081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 583/1054] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:39 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 35206 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:40.832214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-17e70d0f-83d7-46b0-9912-912f495ab269 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:40.833390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-17e70d0f-83d7-46b0-9912-912f495ab269 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:40.840988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17e70d0f-83d7-46b0-9912-912f495ab269 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:40.841432 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17e70d0f-83d7-46b0-9912-912f495ab269 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:40.842251 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17e70d0f-83d7-46b0-9912-912f495ab269 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:40.842691 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-17e70d0f-83d7-46b0-9912-912f495ab269 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:40.919459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-17e70d0f-83d7-46b0-9912-912f495ab269 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 36308 microversion: 2.20 time: 0.091793 Nov 16 16:22:40.919991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 472/1055] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:40 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 36308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:41.932477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a1fe25f3-311e-4a4e-9589-d019082db348 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:41.933447 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a1fe25f3-311e-4a4e-9589-d019082db348 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:41.940966 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1fe25f3-311e-4a4e-9589-d019082db348 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:41.941410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1fe25f3-311e-4a4e-9589-d019082db348 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:41.942184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1fe25f3-311e-4a4e-9589-d019082db348 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:41.942636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1fe25f3-311e-4a4e-9589-d019082db348 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:42.049254 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a1fe25f3-311e-4a4e-9589-d019082db348 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 37796 microversion: 2.20 time: 0.120429 Nov 16 16:22:42.050279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 584/1056] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:41 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 37796 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:43.066516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-128231c0-fc10-419d-bd17-6013f08f5299 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:43.067678 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-128231c0-fc10-419d-bd17-6013f08f5299 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:43.076099 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-128231c0-fc10-419d-bd17-6013f08f5299 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:43.076619 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-128231c0-fc10-419d-bd17-6013f08f5299 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:43.077531 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-128231c0-fc10-419d-bd17-6013f08f5299 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:43.078039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-128231c0-fc10-419d-bd17-6013f08f5299 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:43.162475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-128231c0-fc10-419d-bd17-6013f08f5299 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 38222 microversion: 2.20 time: 0.100214 Nov 16 16:22:43.163535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 473/1057] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:43 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 38222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:44.177895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e3f89d18-9144-47d7-a1ba-07fb372e8bc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:44.178968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e3f89d18-9144-47d7-a1ba-07fb372e8bc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:44.185983 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3f89d18-9144-47d7-a1ba-07fb372e8bc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:44.186446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3f89d18-9144-47d7-a1ba-07fb372e8bc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:44.187221 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3f89d18-9144-47d7-a1ba-07fb372e8bc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:44.187696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3f89d18-9144-47d7-a1ba-07fb372e8bc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:44.252089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e3f89d18-9144-47d7-a1ba-07fb372e8bc1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 38222 microversion: 2.20 time: 0.078205 Nov 16 16:22:44.252735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 585/1058] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:44 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 38222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:45.269844 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-052fd1b3-aae9-4926-a02f-b122d99685b8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:45.271505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-052fd1b3-aae9-4926-a02f-b122d99685b8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:45.279639 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-052fd1b3-aae9-4926-a02f-b122d99685b8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:45.280101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-052fd1b3-aae9-4926-a02f-b122d99685b8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:45.280896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-052fd1b3-aae9-4926-a02f-b122d99685b8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:45.281316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-052fd1b3-aae9-4926-a02f-b122d99685b8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:45.343232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-052fd1b3-aae9-4926-a02f-b122d99685b8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 38222 microversion: 2.20 time: 0.080609 Nov 16 16:22:45.343858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 474/1059] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:45 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 38222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:46.360980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5acdde4f-5cfe-47d8-befc-409b8becaf1f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:46.362654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5acdde4f-5cfe-47d8-befc-409b8becaf1f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:46.374756 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5acdde4f-5cfe-47d8-befc-409b8becaf1f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:46.375566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5acdde4f-5cfe-47d8-befc-409b8becaf1f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:46.376934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5acdde4f-5cfe-47d8-befc-409b8becaf1f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:46.377680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5acdde4f-5cfe-47d8-befc-409b8becaf1f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:46.464858 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5acdde4f-5cfe-47d8-befc-409b8becaf1f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 38230 microversion: 2.20 time: 0.110741 Nov 16 16:22:46.465696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 586/1060] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:46 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 38230 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:47.478471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-478f51ea-76b7-4791-875b-0c5cf7a5a124 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:47.479464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-478f51ea-76b7-4791-875b-0c5cf7a5a124 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:47.486782 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-478f51ea-76b7-4791-875b-0c5cf7a5a124 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:47.487231 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-478f51ea-76b7-4791-875b-0c5cf7a5a124 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:47.488011 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-478f51ea-76b7-4791-875b-0c5cf7a5a124 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:47.488445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-478f51ea-76b7-4791-875b-0c5cf7a5a124 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:47.571621 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-478f51ea-76b7-4791-875b-0c5cf7a5a124 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 200 len: 38363 microversion: 2.20 time: 0.096971 Nov 16 16:22:47.572599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 475/1061] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:47 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 38363 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:47.588087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-06917ea6-0c9c-41c8-a2b9-8578acd1ebad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:47.588636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-06917ea6-0c9c-41c8-a2b9-8578acd1ebad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:47.596233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06917ea6-0c9c-41c8-a2b9-8578acd1ebad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:47.596680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06917ea6-0c9c-41c8-a2b9-8578acd1ebad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:47.597466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06917ea6-0c9c-41c8-a2b9-8578acd1ebad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:47.597891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-06917ea6-0c9c-41c8-a2b9-8578acd1ebad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:47.622006 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-06917ea6-0c9c-41c8-a2b9-8578acd1ebad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/ips" status: 200 len: 152 microversion: 2.20 time: 0.039837 Nov 16 16:22:47.622608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 587/1062] 10.222.0.61 () {60 vars in 1288 bytes} [Tue Nov 16 16:22:47 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:22:49.800558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:49.801168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:49.808804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:49.809295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:49.810100 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:49.810552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:49.840852 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lazy-loading 'flavor' on Instance uuid be607369-0706-46d3-9745-8e5549afb1ec {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:22:50.140097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4bce7a96-cf18-44c3-b9b9-a5d83fee1a64 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 202 len: 0 microversion: 2.20 time: 0.343494 Nov 16 16:22:50.140822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 476/1063] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:22:49 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:22:50.149121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:50.149774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:50.156118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:50.156515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:50.157318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:50.157755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:50.312022 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:50.320317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:50.322236 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:50.323413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-226929d2-9481-4bf5-ad60-49c5dbdf32f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.178010 Nov 16 16:22:50.323965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 588/1064] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:50 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:50.410185 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:50.410846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:50.417910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:50.418357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:50.419185 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:50.419623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:50.500022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lazy-loading 'services' on Instance uuid 5ff0d2f3-de31-4eda-aed0-b37837391d69 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:22:50.582816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5fd2c70e-b465-4813-ab0a-25cb089381f3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-volume_attachments/c4203248-71b4-45cf-a6d8-54aafc77c38f" status: 202 len: 0 microversion: 2.1 time: 0.176566 Nov 16 16:22:50.583385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 477/1065] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:22:50 2021] DELETE /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-volume_attachments/c4203248-71b4-45cf-a6d8-54aafc77c38f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:51.342810 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:51.343510 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:51.349955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:51.350408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:51.351226 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:51.351653 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:51.494263 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:51.503109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:51.504576 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:51.505718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-84b59348-4cda-4712-ad6f-c8e72a26b9c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.166961 Nov 16 16:22:51.506276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 589/1066] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:51 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:51.698826 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e9c9fed5-0869-4cb2-bbea-096100cbe60b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:22:51.706101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9c9fed5-0869-4cb2-bbea-096100cbe60b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:51.706589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e9c9fed5-0869-4cb2-bbea-096100cbe60b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:51.730478 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e9c9fed5-0869-4cb2-bbea-096100cbe60b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Going to try to stop instance {{(pid=116168) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 16 16:22:51.775961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e9c9fed5-0869-4cb2-bbea-096100cbe60b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 202 len: 0 microversion: 2.1 time: 0.083637 Nov 16 16:22:51.776599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 478/1067] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:22:51 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:22:51.784736 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:51.785334 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:51.792240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:51.792723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:51.793545 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:51.793994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:51.928349 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:51.936407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f14a6d59-3d20-4930-a192-fd16d91a470d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.155364 Nov 16 16:22:51.936988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 590/1068] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:22:51 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:52.530290 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:52.531406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:52.541486 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:52.541934 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:52.542900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:52.543341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:52.709890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:52.720040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:52.721570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:52.722774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bb84f216-e035-4e32-81b0-a11866a08f53 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.199864 Nov 16 16:22:52.723339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 479/1069] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:52 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:52.958751 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:52.959613 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:52.967350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:52.967790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:52.968551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:52.968971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:53.119673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:53.132379 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0738817e-6c17-4299-9825-ad176538bc8a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.179610 Nov 16 16:22:53.133219 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 591/1070] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:22:52 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:53.742057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:53.742681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:53.749537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:53.749984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:53.750807 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:53.751230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:53.887455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:53.896405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:53.897890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:53.899093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-01fa1507-9713-45fa-a959-f6416bef02d6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.161051 Nov 16 16:22:53.899653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 480/1071] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:53 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:54.152217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:54.152899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:54.160721 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:54.161246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:54.162153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:54.162694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:54.311145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:54.319270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f860490f-9a05-4e8c-b3d6-696d945f38a1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.171797 Nov 16 16:22:54.319842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 592/1072] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:22:54 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:54.927981 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:54.928914 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:54.936942 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:54.937378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:54.938142 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:54.938603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:55.086084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:55.094760 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:55.096247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:55.097416 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f3689722-eaa5-4d77-a918-e83066880236 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.176007 Nov 16 16:22:55.097982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 481/1073] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:54 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:55.340650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:55.341670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:55.352666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:55.353431 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:55.354552 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:55.355005 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:55.497970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:55.507066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a9b39a93-c445-4138-831b-4efe288b8674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.172615 Nov 16 16:22:55.507615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 593/1074] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:22:55 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:56.120618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:56.121545 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:56.132136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:56.132849 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:56.134096 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:56.134834 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:56.275435 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:56.284420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:56.285906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:56.287101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a70e7677-d236-4321-b071-632938cc9ff2 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.173120 Nov 16 16:22:56.287664 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 482/1075] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:56 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:56.528531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:56.529359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:56.536384 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:56.536825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:56.537607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:56.538037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:56.685170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:56.697107 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-63e3f7da-9dae-49f8-89b6-c74ba98c63da tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.174517 Nov 16 16:22:56.697871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 594/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:22:56 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:57.313870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:57.314655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:57.323504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:57.324067 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:57.325150 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:57.325741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:57.474036 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:57.483216 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:57.485284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:57.486431 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-19854ad5-b971-4561-bebd-6b282e97dbf4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.179319 Nov 16 16:22:57.487039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 483/1077] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:57 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:57.718928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:57.719762 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:57.730450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:57.731230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:57.732539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:57.732969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:57.882318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:57.893422 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5c8d5b23-7a4c-410a-a78f-ffe1f3bf3988 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.181022 Nov 16 16:22:57.894160 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 595/1078] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:22:57 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:58.509061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:58.510056 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:58.521669 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:58.522465 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:58.523713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:58.524417 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:58.670182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:58.678971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:58.680484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:58.681646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-87758ee9-0cdf-4e11-9804-cfd0c372d43b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.178923 Nov 16 16:22:58.682205 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 484/1079] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:58 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:22:58.915228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:58.916220 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:58.924614 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:58.924987 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:58.925751 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:58.926179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:59.073432 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:59.081901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8622e247-7627-46a1-9496-aec06e1d9ba9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.172883 Nov 16 16:22:59.082502 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 596/1080] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:22:58 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:22:59.703526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:22:59.704739 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:22:59.711677 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:59.712155 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:59.713031 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:22:59.713459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:22:59.858168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:59.866243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:59.867751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:22:59.868895 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-12a88224-def3-455a-a7ad-ac1c7204c33d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.171079 Nov 16 16:22:59.869460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 485/1081] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:22:59 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:00.103195 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:00.104146 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:00.115039 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:00.115790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:00.117241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:00.117956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:00.266090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:00.276993 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-25713a7a-dc97-40c9-8e0f-0e418f2f7223 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.179868 Nov 16 16:23:00.277807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 597/1082] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:00 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:00.891972 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:00.892911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:00.903554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:00.904301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:00.905349 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:00.905802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:01.064207 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:01.072459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:01.073933 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:01.075146 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ae651b5c-6470-4a68-9955-c34b018e057b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.189906 Nov 16 16:23:01.075701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 486/1083] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:00 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:01.299682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:01.300313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:01.307234 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:01.307679 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:01.308465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:01.308894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:01.448473 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:01.457437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5839bb91-e0dd-4aa4-b83f-792a6707cc12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1676 microversion: 2.1 time: 0.164851 Nov 16 16:23:01.458037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 598/1084] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:01 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:02.094532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:02.095174 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:02.101636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:02.102095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:02.102899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:02.103331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:02.239965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:02.247970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:02.249453 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:02.251318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7885e8b3-74d5-4f6d-affa-647e7ac01d12 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1745 microversion: 2.20 time: 0.160432 Nov 16 16:23:02.251897 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 487/1085] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:02 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:02.479141 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:02.480138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:02.490945 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:02.491678 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:02.493031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:02.493704 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:02.632920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:02.641015 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8c7e4852-9986-40dd-b0e9-1b21551b5731 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1653 microversion: 2.1 time: 0.168005 Nov 16 16:23:02.641645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 599/1086] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:02 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1653 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:02.658248 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4dbf2034-e194-4feb-be79-631d0e6fef8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:02.664994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4dbf2034-e194-4feb-be79-631d0e6fef8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:02.665443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4dbf2034-e194-4feb-be79-631d0e6fef8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:02.689978 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4dbf2034-e194-4feb-be79-631d0e6fef8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Going to try to start instance {{(pid=116168) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 16 16:23:02.739954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4dbf2034-e194-4feb-be79-631d0e6fef8e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action" status: 202 len: 0 microversion: 2.1 time: 0.085585 Nov 16 16:23:02.740636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 488/1087] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:23:02 2021] POST /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:23:02.749088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:02.749806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:02.756222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:02.756674 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:02.757578 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:02.758192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:02.926820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:02.934664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6f137d3f-bcc6-447b-bb09-9ef011cb151a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1662 microversion: 2.1 time: 0.189301 Nov 16 16:23:02.935299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 600/1088] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:02 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1662 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:03.271148 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:03.271833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:03.278365 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:03.278843 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:03.279628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:03.280052 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:03.473469 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:03.481510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:03.483026 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:03.484260 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6d6dda2a-33c5-4614-8701-dad16057adb6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1745 microversion: 2.20 time: 0.217290 Nov 16 16:23:03.485044 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 489/1089] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:03 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1745 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:03.956659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:03.957750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:03.968382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:03.969017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:03.969840 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:03.970685 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:04.111129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:04.118975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-274545ed-d8ea-4a4e-a563-7da907873dcb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1662 microversion: 2.1 time: 0.168710 Nov 16 16:23:04.119525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 601/1090] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:03 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:04.506913 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:04.507948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:04.518157 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:04.518612 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:04.519385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:04.519819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:04.654125 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:04.667036 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:04.669281 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:04.670994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-56b4e4e4-9acd-440c-9de3-965d72e53d68 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1745 microversion: 2.20 time: 0.170328 Nov 16 16:23:04.671528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 490/1091] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:04 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:05.059064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-7bf8cbb4-d694-43bf-8262-74f890e09d20 req-d5c2ba8a-7b1a-4afc-9a29-e93bc7956417 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be607369-0706-46d3-9745-8e5549afb1ec", "name": "network-vif-plugged", "status": "completed", "tag": "8b0ab530-8322-4d7c-a925-57b347432f28"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:05.060645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:23:05.060645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:23:05.068358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-7bf8cbb4-d694-43bf-8262-74f890e09d20 req-d5c2ba8a-7b1a-4afc-9a29-e93bc7956417 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:05.068797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-7bf8cbb4-d694-43bf-8262-74f890e09d20 req-d5c2ba8a-7b1a-4afc-9a29-e93bc7956417 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:05.080445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-7bf8cbb4-d694-43bf-8262-74f890e09d20 req-d5c2ba8a-7b1a-4afc-9a29-e93bc7956417 service nova] Creating event network-vif-plugged:8b0ab530-8322-4d7c-a925-57b347432f28 for instance be607369-0706-46d3-9745-8e5549afb1ec on hv-cinder-78776 Nov 16 16:23:05.085964 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-7bf8cbb4-d694-43bf-8262-74f890e09d20 req-d5c2ba8a-7b1a-4afc-9a29-e93bc7956417 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030608 Nov 16 16:23:05.086685 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 602/1092] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:23:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:23:05.136842 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:05.137475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:05.144081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:05.144534 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:05.145314 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:05.145753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:05.304931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:05.312839 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b910b5b9-93f8-4812-a822-1518b92e4d0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1666 microversion: 2.1 time: 0.179340 Nov 16 16:23:05.313476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 491/1093] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:05 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1666 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:05.694974 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:05.696103 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:05.706871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:05.707609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:05.708888 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:05.709611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:05.880554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:05.888948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:05.890519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:05.891969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-efe9b331-87a0-4137-a4ee-053614fd70b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1745 microversion: 2.20 time: 0.203961 Nov 16 16:23:05.892530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 603/1094] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:05 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:06.914132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:06.914816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:06.924276 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:06.924727 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:06.925512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:06.925945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:07.075771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:07.087896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:07.090200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:07.092006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b7f47ffe-852c-4997-8ef5-edea4cba7d86 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1745 microversion: 2.20 time: 0.183993 Nov 16 16:23:07.092854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 492/1095] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:06 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1745 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:08.111636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:08.112275 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:08.119796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:08.120833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:08.121188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:08.121634 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:08.266754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:08.274881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:08.277202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:08.278407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2ff29b57-db3d-4b79-905a-4309c0b8966f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.171049 Nov 16 16:23:08.278948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 604/1096] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:08 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:09.297370 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:09.298219 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:09.305060 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:09.305521 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:09.306313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:09.306777 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:09.457447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:09.466737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:09.468538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:09.469968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a600b32c-df50-4013-9d73-81c26105a8ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.176198 Nov 16 16:23:09.470675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 493/1097] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:09 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:23:10.498763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:10.500080 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:10.507029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:10.507464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:10.508242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:10.509008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:10.680078 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:10.690424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:10.692172 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:10.693497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-de72698b-92bc-46e9-83b2-c6720a8a658a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.208351 Nov 16 16:23:10.703970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 605/1098] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:10 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:11.711793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:11.712481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:11.719452 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:11.720267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:11.721065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:11.721497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:11.871164 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:11.885415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:11.887029 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:11.889658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d1a6d141-21e0-4450-93e4-11b79eb235ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.181786 Nov 16 16:23:11.901686 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 494/1099] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:11 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:12.909179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:12.910016 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:12.917800 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:12.918283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:12.919129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:12.919565 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:13.059784 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:13.068409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:13.069897 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:13.071208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c91f587d-ea12-4c18-814e-ae7c4abb1c60 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.166097 Nov 16 16:23:13.082571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 606/1100] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:12 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:14.089938 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:14.090552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:14.100488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:14.100903 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:14.101892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:14.102298 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:14.261868 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:14.271107 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:14.272957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:14.274252 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1d6781c1-e62d-4535-a3d8-4c2730382251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.188078 Nov 16 16:23:14.275435 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 495/1101] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:14 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:15.295065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:15.296560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:15.303746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:15.304195 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:15.304982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:15.305417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:15.457693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:15.466267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:15.468182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:15.473481 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-97a08693-dccf-4991-97b0-d4320542d581 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.181720 Nov 16 16:23:15.473918 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 607/1102] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:15 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:16.492238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:16.492847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:16.499887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:16.500467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:16.501625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:16.502065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:16.669129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:16.679873 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:16.682108 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:16.683400 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-51537f79-6d94-4cca-b843-fddd0df15996 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.195109 Nov 16 16:23:16.696413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 496/1103] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:16 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:17.701618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:17.702202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:17.709232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:17.709671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:17.710460 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:17.710880 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:17.850326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:17.862832 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:17.865113 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:17.866794 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-22cbd570-15d8-4103-9224-a279075ca05f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1740 microversion: 2.20 time: 0.169044 Nov 16 16:23:17.867572 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 608/1104] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:17 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:18.892176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:18.892760 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:18.901517 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:18.902085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:18.903316 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:18.903853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:19.065018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:19.073999 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:19.075515 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:19.076708 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-55208226-5c7a-401f-9338-287bcb938ba1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1722 microversion: 2.20 time: 0.191080 Nov 16 16:23:19.077282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 497/1105] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:18 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:20.098404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:20.099557 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:20.107102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:20.107673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:20.109059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:20.109901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:20.249664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:20.258585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:20.260094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:20.261244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-fb2ea91c-65a3-4780-a250-39774b6f0194 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1722 microversion: 2.20 time: 0.167934 Nov 16 16:23:20.261806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 609/1106] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:20 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:21.283980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:21.285047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:21.296226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:21.296977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:21.298138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:21.298608 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:21.439360 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:21.448350 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:21.449832 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:21.451040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-30ec94bd-9032-4e7e-ba43-71471fbc17d4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1665 microversion: 2.20 time: 0.173337 Nov 16 16:23:21.451602 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 498/1107] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:21 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:21.477433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9c0c0563-53f5-41e1-b6d8-a435e2688ebb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "812bc842-67ec-4dfc-9abb-f29e828d38b2"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:21.478837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9c0c0563-53f5-41e1-b6d8-a435e2688ebb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:21.488486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c0c0563-53f5-41e1-b6d8-a435e2688ebb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:21.489133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c0c0563-53f5-41e1-b6d8-a435e2688ebb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:21.490294 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c0c0563-53f5-41e1-b6d8-a435e2688ebb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:21.490835 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9c0c0563-53f5-41e1-b6d8-a435e2688ebb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:21.795241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9c0c0563-53f5-41e1-b6d8-a435e2688ebb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.322882 Nov 16 16:23:21.795725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 610/1108] 10.222.0.61 () {62 vars in 1363 bytes} [Tue Nov 16 16:23:21 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:23:21.915686 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0fa360db-1c93-4a95-af66-dc9326b7088e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:21.916240 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0fa360db-1c93-4a95-af66-dc9326b7088e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:21.922708 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0fa360db-1c93-4a95-af66-dc9326b7088e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:21.923151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0fa360db-1c93-4a95-af66-dc9326b7088e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:21.923929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0fa360db-1c93-4a95-af66-dc9326b7088e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:21.924353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0fa360db-1c93-4a95-af66-dc9326b7088e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:22.018460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0fa360db-1c93-4a95-af66-dc9326b7088e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action" status: 202 len: 0 microversion: 2.20 time: 0.106338 Nov 16 16:23:22.019020 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 499/1109] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:23:21 2021] POST /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:23:22.027305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:22.028031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:22.035136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:22.035582 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:22.036373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:22.036807 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:22.170763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:22.179336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:22.180824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:22.182372 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-51d2a0d4-adca-40d7-93a1-00b42f4499ae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1751 microversion: 2.20 time: 0.158599 Nov 16 16:23:22.182695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 611/1110] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:22 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:23.099544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-02bb1ecf-dde5-4e1a-947e-d85992eaa5a5 req-a788f41f-98ca-450a-b0ca-b5819e636a63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be607369-0706-46d3-9745-8e5549afb1ec", "name": "network-vif-unplugged", "status": "completed", "tag": "8b0ab530-8322-4d7c-a925-57b347432f28"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:23.101255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:23:23.101255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:23:23.111307 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-02bb1ecf-dde5-4e1a-947e-d85992eaa5a5 req-a788f41f-98ca-450a-b0ca-b5819e636a63 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:23.111843 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-02bb1ecf-dde5-4e1a-947e-d85992eaa5a5 req-a788f41f-98ca-450a-b0ca-b5819e636a63 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:23.125705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.compute.server_external_events [req-02bb1ecf-dde5-4e1a-947e-d85992eaa5a5 req-a788f41f-98ca-450a-b0ca-b5819e636a63 service nova] Unable to find a host for instance be607369-0706-46d3-9745-8e5549afb1ec. Dropping event network-vif-unplugged {{(pid=116168) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 16 16:23:23.127379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-02bb1ecf-dde5-4e1a-947e-d85992eaa5a5 req-a788f41f-98ca-450a-b0ca-b5819e636a63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032345 Nov 16 16:23:23.128101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 500/1111] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:23:23 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 16 16:23:23.200296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:23.200921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:23.207959 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:23.208395 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:23.209161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:23.209585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:23.345852 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:23.354778 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:23.356261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:23.357445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-62265550-b3d9-42fe-ad2e-6c39900b2b85 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1751 microversion: 2.20 time: 0.160973 Nov 16 16:23:23.358000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 612/1112] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:23 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:24.380005 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:24.380775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:24.387497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:24.388317 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:24.389102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:24.389538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:24.529733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:24.539976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:24.541469 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:24.542684 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ae6f12e9-865c-4d36-85f7-320a754bd0ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1751 microversion: 2.20 time: 0.168426 Nov 16 16:23:24.543230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 501/1113] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:24 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:25.564917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:25.565842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:25.577273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:25.578010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:25.579314 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:25.580019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:25.733738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:25.746494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:25.748825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:25.750695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0aecf05f-3d89-469b-9ce7-06a7d9cb04ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1751 microversion: 2.20 time: 0.191776 Nov 16 16:23:25.751514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 613/1114] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:25 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:26.774908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:26.775963 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:26.786544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:26.786998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:26.787793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:26.788233 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:27.079284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:27.088154 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:27.089624 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:27.090836 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d8c4ab7d-8a6b-4c42-8a1a-bc87286f29c0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1751 microversion: 2.20 time: 0.322349 Nov 16 16:23:27.091409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 502/1115] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:26 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1751 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:28.109253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:28.109861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:28.117078 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:28.117524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:28.118412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:28.118856 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:28.252411 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:28.261218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:28.262705 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:28.264202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-722b0672-2668-4d88-ab95-67141083db35 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.158896 Nov 16 16:23:28.264754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 614/1116] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:28 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:29.283048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:29.283627 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:29.290343 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:29.290822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:29.291598 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:29.292026 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:29.436033 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:29.447682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:29.450039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:29.451516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4e13e44a-9620-4e23-bf76-710443aa579c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.172109 Nov 16 16:23:29.452471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 503/1117] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:29 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:30.476902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:30.477570 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:30.484688 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:30.485188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:30.486002 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:30.486460 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:30.632648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:30.641265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:30.642801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:30.643972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b789e044-646a-49bf-be2c-e8921ee1137b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.173865 Nov 16 16:23:30.644738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 615/1118] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:30 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:31.665318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:31.665947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:31.672423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:31.672854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:31.673633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:31.674066 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:31.815862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:31.824788 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:31.826252 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:31.827446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-952b6fe3-debf-4b04-8140-d81a3e49360e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.168077 Nov 16 16:23:31.828235 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 504/1119] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:31 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:32.845080 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:32.845723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:32.851999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:32.852471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:32.853239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:32.853656 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:33.005610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:33.017643 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:33.019235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:33.020446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-29e91f3e-3940-49d8-b5c9-60e55349b94e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.179092 Nov 16 16:23:33.021316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 616/1120] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:32 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:23:34.041689 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:34.042630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:34.050332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:34.050936 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:34.051848 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:34.052369 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:34.126143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:34.126851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:34.133424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:34.133929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:34.135336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:34.135336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:34.170371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lazy-loading 'flavor' on Instance uuid 78eb3995-5e51-438c-932d-e5740e28c38e {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:23:34.195171 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:34.204420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:34.205902 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:34.207119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7d787888-0f92-4a79-bc24-c8cec18db29d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.170207 Nov 16 16:23:34.207924 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 505/1121] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:34 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:34.259822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7e6a08d3-ff33-40ef-abe8-f9e53a76d08d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "POST /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e/action" status: 202 len: 0 microversion: 2.1 time: 0.137296 Nov 16 16:23:34.263992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 617/1122] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:23:34 2021] POST /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:23:34.269095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:34.269703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:34.275907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:34.276356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:34.277137 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:34.277568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:34.423435 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:34.430994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b299a07d-85eb-4759-82e6-9f362fd1a6d9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.165702 Nov 16 16:23:34.431530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 506/1123] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:34 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:35.231323 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:35.232433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:35.243942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:35.244389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:35.245168 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:35.245607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:35.400687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:35.410885 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:35.412557 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:35.413876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-731035ce-6334-4501-929a-819a2dae7579 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.190341 Nov 16 16:23:35.414935 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 618/1124] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:35 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:35.453278 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:35.453961 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:35.460964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:35.461355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:35.462131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:35.462763 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:35.609471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:35.617102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cb0d53d2-6f24-42b3-a553-231ee6a62d94 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.167611 Nov 16 16:23:35.617664 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 507/1125] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:35 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:36.432934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:36.433593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:36.440396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:36.440841 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:36.441612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:36.442042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:36.594222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:36.604625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:36.606162 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:36.607403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2b1e33ea-b38f-4dff-9a98-63d7818d27ab tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.178398 Nov 16 16:23:36.607989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 619/1126] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:36 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:36.634355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:36.635180 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:36.642026 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:36.642512 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:36.643295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:36.643761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:36.802047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:36.809711 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4e977a2a-a60b-4292-9510-ce51ede20751 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.179157 Nov 16 16:23:36.810279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 508/1127] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:36 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:37.634266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:37.635346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:37.643760 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:37.644215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:37.645112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:37.645550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:37.793312 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:37.802153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:37.803649 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:37.804805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c7c6cc14-8c83-4c24-8e77-7a214530f5aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.176675 Nov 16 16:23:37.805594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 620/1128] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:37 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:37.831111 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:37.831724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:37.837862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:37.838290 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:37.839193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:37.839593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:37.976005 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:37.984282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e7149a66-c160-4b34-92ee-b9aa253414f2 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.157007 Nov 16 16:23:37.984841 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 509/1129] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:37 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:38.826227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:38.826913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:38.836127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:38.836729 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:38.837887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:38.838452 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:38.989253 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:38.997485 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:38.999049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:39.000240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-af9c0059-5bb8-4aa2-8db2-c66c3b4441bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.179963 Nov 16 16:23:39.000813 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 621/1130] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:38 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:39.006051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:39.006675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:39.013646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:39.014145 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:39.014984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:39.015408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:39.156467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:39.171837 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-39bd28b8-fab1-4f42-a64b-03b5695b26f1 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.168677 Nov 16 16:23:39.193235 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 510/1131] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:38 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:23:40.019548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:40.022036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:40.030212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:40.031540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:40.032911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:40.033653 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:40.177990 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:40.187116 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:40.188570 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:40.189781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5255ac56-b3b1-4dc8-a90f-cd97bc381911 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.174350 Nov 16 16:23:40.190336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 622/1132] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:40 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:40.196259 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:40.196848 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:40.203332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:40.203786 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:40.204559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:40.204999 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:40.354959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:40.371155 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-24953545-12c6-4f6c-bd2f-a410d0cbc411 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.178477 Nov 16 16:23:40.388480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 511/1133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:40 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:41.209062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:41.210668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:41.217658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:41.218223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:41.219119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:41.219660 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:41.362745 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:41.371300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:41.372781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:41.373939 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5bbc223e-eb12-471a-9e3b-ce1f0698ad21 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.168873 Nov 16 16:23:41.374594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 623/1134] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:41 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:41.387896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:41.388514 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:41.395434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:41.395881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:41.396655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:41.397091 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:41.573190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:41.580986 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd7ed14f-b7cd-4433-8c9d-c870e8f233fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.197184 Nov 16 16:23:41.581547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 512/1135] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:41 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:42.393730 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:42.394301 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:42.401183 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:42.401630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:42.402406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:42.402884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:42.565007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:42.581225 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:42.587796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:42.589731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-62c65511-7a13-42ac-9b62-2fdb1dfd9621 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.199951 Nov 16 16:23:42.597653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:42.599105 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:42.601740 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 624/1136] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:42 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:42.615232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:42.615682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:42.616494 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:42.616929 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:42.771839 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:42.780129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ff2b614a-59d4-4eea-af21-aaae3a2b7b1a tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.186776 Nov 16 16:23:42.780685 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 513/1137] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:42 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:43.613175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:43.613781 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:43.620635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:43.621073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:43.621838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:43.622266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:43.767163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:43.776027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:43.777515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:43.778719 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e2ac7132-5568-4d5f-af06-f38bda172fd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.170218 Nov 16 16:23:43.779273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 625/1138] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:43 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:43.798108 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:43.798720 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:43.805545 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:43.805993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:43.806805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:43.807234 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:43.948853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:43.961102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fc4aed9e-2f92-4af1-b1ec-3d1ce70be1b3 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.166451 Nov 16 16:23:43.961796 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 514/1139] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:43 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:44.798337 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:44.799060 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:44.806767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:44.807271 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:44.808156 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:44.808642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:44.960170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:44.968981 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:44.970884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:44.972035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-82fe642a-f968-45e0-bd7a-5a38eee47f2f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.177955 Nov 16 16:23:44.972585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 626/1140] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:44 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:44.980868 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:44.981587 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:44.988697 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:44.989246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:44.990028 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:44.990498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:45.130827 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:45.142890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-af14619c-2521-42c3-8d51-53ef263135aa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.165346 Nov 16 16:23:45.143735 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 515/1141] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:44 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:45.990720 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:45.991315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:45.998370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:45.998865 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:45.999825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:46.000266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:46.159819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:46.160410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:46.167121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:46.167572 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:46.168364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:46.168820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:46.251045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:46.259947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:46.261426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:46.262979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cc6ebea9-83cc-4715-9c39-15f34664a14a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.275737 Nov 16 16:23:46.263529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 627/1142] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:45 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:46.404986 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:46.413112 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6bcee44a-0749-4138-bccb-8525b6b14bef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.257267 Nov 16 16:23:46.413684 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 516/1143] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:46 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:47.281288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:47.281836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:47.288684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:47.289129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:47.289912 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:47.290353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:47.432294 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:47.432916 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:47.433861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:47.439821 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:47.440267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:47.441049 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:47.441483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:47.442676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:47.444150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:47.445289 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6adf4481-b594-4da3-9689-44392d36066a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.167905 Nov 16 16:23:47.445856 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 628/1144] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:47 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:47.585084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:47.593393 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d19486de-fa32-4fcf-875a-c4a4525c25ba tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.165203 Nov 16 16:23:47.593950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 517/1145] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:47 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:48.470122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:48.470723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:48.477273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:48.477700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:48.478524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:48.478932 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:48.610902 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:48.611535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:48.618774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:48.619235 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:48.620024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:48.620442 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:48.625195 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:48.634440 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:48.636041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:48.637191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c7b7056e-753d-4d1d-a4a9-a10fe1ea0514 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.173353 Nov 16 16:23:48.638448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 629/1146] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:48 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:48.769612 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:48.780950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-99f6dad3-3aef-42e7-a13a-ef8ff3704705 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.173495 Nov 16 16:23:48.782015 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 518/1147] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:48 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:49.660072 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:49.660645 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:49.670815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:49.671435 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:49.672438 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:49.672921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:49.803067 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:49.803713 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:49.810672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:49.811136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:49.811918 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:49.812355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:49.817209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:49.825959 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:49.827476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:49.828677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e19b17b9-b41e-4f7a-9a8d-c00c8c5427b5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.174526 Nov 16 16:23:49.829416 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 630/1148] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:49 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:49.954668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:49.966260 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-87698b77-21b0-4ad5-a905-a6224aebb514 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.166763 Nov 16 16:23:49.967053 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 519/1149] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:49 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:50.849882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:50.850621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:50.858413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:50.858988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:50.859981 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:50.860675 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:50.985090 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:50.985785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:50.992306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:50.992760 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:50.993540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:50.993971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:51.010891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:51.019687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:51.021176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:51.022326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cb5bc24b-c83d-4a4a-ad61-93dbabfc6682 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.177137 Nov 16 16:23:51.022919 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 631/1150] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:50 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:51.131429 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:51.143193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e4bfc61b-7cc4-48a5-8b6b-562c79c4cd39 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.161991 Nov 16 16:23:51.143772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 520/1151] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:50 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:52.045395 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:52.046458 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:52.057561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:52.058320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:52.059664 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:52.060392 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:52.160393 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:52.160976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:52.167806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:52.168254 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:52.169038 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:52.169474 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:52.222027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:52.231020 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:52.232473 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:52.233627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7cfcd0df-e366-4969-97fe-75f1ca3b08dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.194610 Nov 16 16:23:52.234190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 632/1152] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:52 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:52.311723 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:52.320019 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-54dda659-6c16-4a5f-9f35-0126fb48457c tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.163781 Nov 16 16:23:52.320582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 521/1153] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:52 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:53.256445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:53.257389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:53.268394 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:53.268394 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:53.269219 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:53.269833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:53.337306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:53.337930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:53.344558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:53.345001 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:53.345793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:53.346220 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:53.444854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:53.455200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:53.456758 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:53.457944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9f0f12b9-c7c1-48f0-bba7-9f3e7e7e3111 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.207899 Nov 16 16:23:53.458500 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 633/1154] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:53 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:53.513315 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:53.522685 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-25b647b2-b9a3-44a6-99a1-56482b5a756b tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.189029 Nov 16 16:23:53.523243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 522/1155] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:53 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:23:54.480471 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:54.481546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:54.495747 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:54.496512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:54.497784 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:54.498518 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:54.543982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:54.544590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:54.554926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:54.555480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:54.556629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:54.557230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:54.682791 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:54.692092 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:54.693561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:54.694741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4d27c4b7-9852-441d-9b89-5510ef8a6e31 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.220530 Nov 16 16:23:54.704812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 634/1156] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:54 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:54.732756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:54.741267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-56bd5577-bd12-402d-b59e-4eb9c0ca43ef tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.203350 Nov 16 16:23:54.741813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 523/1157] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:54 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:55.713274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:55.713925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:55.720861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:55.721300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:55.722094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:55.722571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:55.760687 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:55.761355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:55.769022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:55.769504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:55.770292 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:55.770754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:55.926177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:55.936427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:55.938249 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:55.939464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4a75a9ba-1715-4c21-b108-57eb7a7ab6d8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.230203 Nov 16 16:23:55.940229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 635/1158] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:55 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:55.972538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:55.980263 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-90620fd3-52ad-4a05-b2ad-d11f5af65960 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.225611 Nov 16 16:23:55.990246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 524/1159] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:55 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:56.959286 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:56.960054 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:56.969942 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:56.970692 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:56.971815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:56.972446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:56.997040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:56.997627 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:57.004454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:57.004900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:57.005696 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:57.006126 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:57.171353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:57.180809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:57.182299 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:57.183728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ff7ed935-9152-4621-ac64-55bb5275c7d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.230120 Nov 16 16:23:57.186138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 636/1160] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:56 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:57.188962 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:57.197266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-46f7bdaa-fe8b-4b2a-ab0c-461b198fb821 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.203852 Nov 16 16:23:57.197822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 525/1161] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:56 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:57.335514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-e4519edb-6572-44c3-a77e-2397d275817c req-270f9e73-26e0-4110-9469-269b5dcee6a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be607369-0706-46d3-9745-8e5549afb1ec", "name": "network-vif-plugged", "status": "completed", "tag": "8b0ab530-8322-4d7c-a925-57b347432f28"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:57.337148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:23:57.337148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:23:57.345147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e4519edb-6572-44c3-a77e-2397d275817c req-270f9e73-26e0-4110-9469-269b5dcee6a2 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:57.345579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e4519edb-6572-44c3-a77e-2397d275817c req-270f9e73-26e0-4110-9469-269b5dcee6a2 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:57.357088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-e4519edb-6572-44c3-a77e-2397d275817c req-270f9e73-26e0-4110-9469-269b5dcee6a2 service nova] Creating event network-vif-plugged:8b0ab530-8322-4d7c-a925-57b347432f28 for instance be607369-0706-46d3-9745-8e5549afb1ec on hv-cinder-78776 Nov 16 16:23:57.362222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-e4519edb-6572-44c3-a77e-2397d275817c req-270f9e73-26e0-4110-9469-269b5dcee6a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030420 Nov 16 16:23:57.363098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 637/1162] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:23:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:23:58.207521 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:58.208423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:58.218747 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:58.219616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:58.219912 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:58.220162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:58.221038 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:58.221464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:58.227137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:58.227583 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:58.228383 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:58.228815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:58.418577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:58.422331 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:58.427908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:58.429465 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:58.430676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-670f1c23-4be3-4fd0-94c9-aff33096f721 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.218577 Nov 16 16:23:58.430851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-64aa0196-2836-4f4d-845a-0f80bc42b3bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.229905 Nov 16 16:23:58.431273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 638/1163] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:58 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:58.431423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 526/1164] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:58 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:59.452266 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:59.453171 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:59.453797 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:59.455648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:59.461587 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.462118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:59.462693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.463054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.463208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:59.463703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:59.464169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.464773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:59.663189 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:59.667420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:59.675402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b01dc039-aade-4a9e-a62b-ba14c957d604 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1510 microversion: 2.1 time: 0.229209 Nov 16 16:23:59.676160 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 639/1165] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:59 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1510 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:23:59.676580 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:59.678054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:23:59.679437 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-28608eea-ffd2-45ed-9baf-3cc5870048c4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1809 microversion: 2.20 time: 0.233317 Nov 16 16:23:59.685546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 527/1166] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:23:59 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:23:59.696687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-42d3c03e-7e93-41fd-9fde-d8e804352596 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:23:59.697282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-42d3c03e-7e93-41fd-9fde-d8e804352596 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:59.703934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42d3c03e-7e93-41fd-9fde-d8e804352596 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.704387 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42d3c03e-7e93-41fd-9fde-d8e804352596 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:59.705337 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42d3c03e-7e93-41fd-9fde-d8e804352596 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.705782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-42d3c03e-7e93-41fd-9fde-d8e804352596 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:59.844419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-42d3c03e-7e93-41fd-9fde-d8e804352596 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "POST /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e/action" status: 202 len: 0 microversion: 2.1 time: 0.154457 Nov 16 16:23:59.845270 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 640/1167] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:23:59 2021] POST /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:23:59.853528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:23:59.854441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:23:59.860757 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.861189 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:23:59.861987 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:23:59.862455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:00.011086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:00.019300 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1e560b23-7278-4ab0-b76d-2d26e2e36083 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1518 microversion: 2.1 time: 0.169586 Nov 16 16:24:00.019868 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 528/1168] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:23:59 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:00.697930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:00.698554 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:00.704826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:00.705271 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:00.706042 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:00.706512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:00.842246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:00.851511 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:00.853007 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:00.854182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-616255e5-01f4-4ea1-a2e8-e824d33dbe47 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1796 microversion: 2.20 time: 0.160773 Nov 16 16:24:00.854765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 641/1169] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:24:00 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1796 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:24:01.037598 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:01.038318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:01.045108 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:01.045561 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:01.046353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:01.047583 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:01.183850 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:01.191882 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-590b573f-4ddf-4638-b842-31dbcc607689 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.158358 Nov 16 16:24:01.192455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 529/1170] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:01 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:01.296354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-7e161200-f158-4a09-9a9d-a6c6e9ea1b98 req-85108017-f2aa-441c-9979-3dca8a76c0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb3995-5e51-438c-932d-e5740e28c38e", "name": "network-vif-unplugged", "status": "completed", "tag": "e73fa700-ec5c-41fb-b99b-cd813ff621b5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:01.297995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:01.297995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:01.305196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-7e161200-f158-4a09-9a9d-a6c6e9ea1b98 req-85108017-f2aa-441c-9979-3dca8a76c0df service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:01.305638 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-7e161200-f158-4a09-9a9d-a6c6e9ea1b98 req-85108017-f2aa-441c-9979-3dca8a76c0df service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:01.319149 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-7e161200-f158-4a09-9a9d-a6c6e9ea1b98 req-85108017-f2aa-441c-9979-3dca8a76c0df service nova] Creating event network-vif-unplugged:e73fa700-ec5c-41fb-b99b-cd813ff621b5 for instance 78eb3995-5e51-438c-932d-e5740e28c38e on hv-cinder-78776 Nov 16 16:24:01.324455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-7e161200-f158-4a09-9a9d-a6c6e9ea1b98 req-85108017-f2aa-441c-9979-3dca8a76c0df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031707 Nov 16 16:24:01.325506 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 642/1171] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:24:02.212249 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:02.213020 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:02.221989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:02.222592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:02.223613 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:02.224187 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:02.369192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:02.377176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-51e55911-930e-41f5-b42d-16bbb161465d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.170002 Nov 16 16:24:02.377702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 530/1172] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:02 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:03.396138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:03.396830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:03.403608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:03.404059 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:03.404803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:03.405267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:03.557442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:03.567479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e2fe6de6-ba4f-4f8c-88fe-4902b420e880 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.175959 Nov 16 16:24:03.568029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 643/1173] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:03 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:04.589005 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:04.589931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:04.600577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:04.601306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:04.602619 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:04.603327 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:04.743499 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:04.751200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a3bc7b4e-cfdd-46fd-98b4-6c7fdb29f0fa tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.168426 Nov 16 16:24:04.751856 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 531/1174] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:04 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:05.773833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:05.774441 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:05.780666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:05.781113 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:05.781878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:05.782303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:05.934439 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:05.947192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-41f3a0dc-dff8-4b77-bfe8-9f710f782e7d tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.176916 Nov 16 16:24:05.947820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 644/1175] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:05 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:06.970985 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:06.972075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:06.982696 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:06.983445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:06.984711 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:06.985422 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:07.139279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:07.147414 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd77c151-77dc-4cad-a121-f7dc4fa4067f tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.183101 Nov 16 16:24:07.147971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 532/1176] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:06 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:08.058313 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4f20aa2a-b234-450b-9e43-8b20fa827551 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:08.059269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4f20aa2a-b234-450b-9e43-8b20fa827551 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:08.070851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f20aa2a-b234-450b-9e43-8b20fa827551 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.071260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f20aa2a-b234-450b-9e43-8b20fa827551 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.072060 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f20aa2a-b234-450b-9e43-8b20fa827551 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.072496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f20aa2a-b234-450b-9e43-8b20fa827551 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.102343 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4f20aa2a-b234-450b-9e43-8b20fa827551 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050369 Nov 16 16:24:08.102927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 645/1177] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:24:08 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:08.164237 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:08.164885 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:08.168878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:08.169390 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:08.171569 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.172336 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.172775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.173236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.176216 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.176663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.177440 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.177902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.203262 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:24:08.286057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5abe57d0-fa9f-4956-896d-218f39259b0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 204 len: 0 microversion: 2.1 time: 0.120380 Nov 16 16:24:08.286769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 646/1178] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:24:08 2021] DELETE /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:24:08.296524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:08.297223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:08.303248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.303700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.304494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:08.304930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:08.314463 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:08.322300 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2ca572a8-2f73-48c8-b6e8-b1985211a449 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.161800 Nov 16 16:24:08.322906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 533/1179] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:08 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:08.688558 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:08.696819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2e9452c2-811a-4d1a-92ba-952175211535 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1672 microversion: 2.1 time: 0.405509 Nov 16 16:24:08.697393 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 647/1180] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:08 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1672 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:24:09.341165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:09.341795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:09.349385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:09.349861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:09.350675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:09.351112 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:09.525601 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:09.535398 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2424fd04-4c6b-4a23-954e-ca63ea215e7e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.198280 Nov 16 16:24:09.536007 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 534/1181] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:09 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:09.720014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:09.720623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:09.728892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:09.729346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:09.730148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:09.730641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:09.958265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:09.966345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2940ac40-890a-42bb-91df-570e3c4845f2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1672 microversion: 2.1 time: 0.250025 Nov 16 16:24:09.966948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 648/1182] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:09 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1672 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:10.556516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:10.557839 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:10.564484 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:10.565947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:10.566313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:10.566982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:10.792801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-dce6204b-c7b1-46d5-84bd-c966b8a1d90a req-993a3a7b-53ba-4f21-a16b-44619f2322e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff0d2f3-de31-4eda-aed0-b37837391d69", "name": "network-vif-deleted", "tag": "5346365d-2fa2-4b19-bfdf-0c87d7b25d3d"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:10.794371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:10.794371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:10.802504 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-dce6204b-c7b1-46d5-84bd-c966b8a1d90a req-993a3a7b-53ba-4f21-a16b-44619f2322e8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:10.803303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-dce6204b-c7b1-46d5-84bd-c966b8a1d90a req-993a3a7b-53ba-4f21-a16b-44619f2322e8 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:10.815765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-dce6204b-c7b1-46d5-84bd-c966b8a1d90a req-993a3a7b-53ba-4f21-a16b-44619f2322e8 service nova] Creating event network-vif-deleted:5346365d-2fa2-4b19-bfdf-0c87d7b25d3d for instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 on hv-cinder-78776 Nov 16 16:24:10.820304 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:10.822959 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-dce6204b-c7b1-46d5-84bd-c966b8a1d90a req-993a3a7b-53ba-4f21-a16b-44619f2322e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033667 Nov 16 16:24:10.824624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 649/1183] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:24:10.832603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-45f2e1ff-b58d-46e0-9db1-c9be44569c5e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.279536 Nov 16 16:24:10.833405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 535/1184] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:10 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:24:10.985009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:10.985699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:10.993373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:10.993823 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:10.994659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:10.995076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:11.029589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:11.030038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:11.030552 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lazy-loading 'fault' on Instance uuid 5ff0d2f3-de31-4eda-aed0-b37837391d69 {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:24:11.073950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:11.082987 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-74620779-f2f0-4823-835f-1fd2f22f8af3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 200 len: 1326 microversion: 2.1 time: 0.102009 Nov 16 16:24:11.083820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 650/1185] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:10 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:11.850215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:11.851510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:11.862889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:11.863700 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:11.864889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:11.865700 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:12.016389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:12.025116 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3a070a38-ff94-43f1-b0fc-9e326e6299f8 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.179691 Nov 16 16:24:12.031431 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 536/1186] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:11 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:12.102495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:12.103217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:12.108993 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:12.109436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:12.110211 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:12.110676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:12.124666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] HTTP exception thrown: Instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 could not be found. Nov 16 16:24:12.125265 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Returning 404 to user: Instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:24:12.126091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-173656c4-c6c8-4d8c-a8e0-24c4984b9dec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 404 len: 111 microversion: 2.1 time: 0.028337 Nov 16 16:24:12.126892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 651/1187] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:12 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:24:12.135162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7ed30310-4631-49e1-9716-f93d506f89a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '.version_select at 0x7f3ec3672ca0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:12.160040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7ed30310-4631-49e1-9716-f93d506f89a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921566543" status: 202 len: 0 microversion: 2.1 time: 0.028440 Nov 16 16:24:12.161202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 537/1188] 10.222.0.61 () {58 vars in 1217 bytes} [Tue Nov 16 16:24:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921566543 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:24:12.937197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-83099dcc-2506-43d5-9e1f-8134edb734a9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'create', calling method: .version_select at 0x7f3ec367d8b0>, body: {"keypair": {"name": "tempest-keypair-2019451357"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:12.951484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-83099dcc-2506-43d5-9e1f-8134edb734a9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:24:12.955479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-83099dcc-2506-43d5-9e1f-8134edb734a9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for user b54ac91a208046b0ad1ab26903a289a7 and project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:24:13.043151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:13.043732 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:13.050331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:13.050865 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:13.051653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:13.052081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:13.188325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:13.198217 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d35eff91-df65-4b87-ae60-3a7a602d02ae tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.159487 Nov 16 16:24:13.198771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 538/1189] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:13 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:13.344767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-83099dcc-2506-43d5-9e1f-8134edb734a9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:24:13.348872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-83099dcc-2506-43d5-9e1f-8134edb734a9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for user b54ac91a208046b0ad1ab26903a289a7 and project 64e41658de1c433d88953df323d876ba. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:24:13.362495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-83099dcc-2506-43d5-9e1f-8134edb734a9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.429165 Nov 16 16:24:13.369509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 652/1190] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Nov 16 16:24:12 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:13.423906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-79bff957-d894-459a-930e-a5defc00797b req-554c6916-df47-49c4-bed1-877a4fcae143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb3995-5e51-438c-932d-e5740e28c38e", "name": "network-vif-plugged", "status": "completed", "tag": "e73fa700-ec5c-41fb-b99b-cd813ff621b5"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:13.426350 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:13.426350 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:24:13.436250 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-79bff957-d894-459a-930e-a5defc00797b req-554c6916-df47-49c4-bed1-877a4fcae143 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:13.436742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-79bff957-d894-459a-930e-a5defc00797b req-554c6916-df47-49c4-bed1-877a4fcae143 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:13.452325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-79bff957-d894-459a-930e-a5defc00797b req-554c6916-df47-49c4-bed1-877a4fcae143 service nova] Creating event network-vif-plugged:e73fa700-ec5c-41fb-b99b-cd813ff621b5 for instance 78eb3995-5e51-438c-932d-e5740e28c38e on hv-cinder-78776 Nov 16 16:24:13.458080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-79bff957-d894-459a-930e-a5defc00797b req-554c6916-df47-49c4-bed1-877a4fcae143 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038596 Nov 16 16:24:13.459030 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 539/1191] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:24:14.215855 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:14.216461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:14.222805 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:14.223269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:14.224067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:14.224498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:14.456687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:14.464302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-29c622dd-0954-4c73-8012-258377b639da tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1576 microversion: 2.1 time: 0.252294 Nov 16 16:24:14.464876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 653/1192] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:14 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:24:14.840000 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1473953335", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a6c5d706-4c9c-40fa-8a45-39a54b7b888c"}], "security_groups": [{"name": "tempest-securitygroup--703894810"}], "key_name": "tempest-keypair-2019451357", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:14.952102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] validate_networks() for [('a6c5d706-4c9c-40fa-8a45-39a54b7b888c', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:24:15.340147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:24:15.340565 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:24:15.341032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:24:15.341434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:24:15.341835 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:24:15.351159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:15.351606 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:15.352413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:15.352844 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:15.369555 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for project 64e41658de1c433d88953df323d876ba. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:24:15.374003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Getting quotas for user b54ac91a208046b0ad1ab26903a289a7 and project 64e41658de1c433d88953df323d876ba. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:24:15.388137 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:24:15.392024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:24:15.454914 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6d3f4129-73c0-4eba-9176-bfe9e452a359 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.619658 Nov 16 16:24:15.455824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 540/1193] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:24:14 2021] POST /compute/v2.1/servers => generated 401 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:24:15.466147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-464c76f2-d3b2-42fb-9880-f9b59628f2aa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:15.467047 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-464c76f2-d3b2-42fb-9880-f9b59628f2aa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:15.481618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:15.482278 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:15.489178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:15.489633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:15.490460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:15.490884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:15.535129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-464c76f2-d3b2-42fb-9880-f9b59628f2aa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:15.543488 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-464c76f2-d3b2-42fb-9880-f9b59628f2aa tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1238 microversion: 2.1 time: 0.081066 Nov 16 16:24:15.544541 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 654/1194] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:15 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:15.640825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:15.649008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4b13f565-a333-4cea-9e10-43188e920577 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1563 microversion: 2.1 time: 0.171333 Nov 16 16:24:15.649642 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 541/1195] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:15 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:16.561741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:16.562356 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:16.570288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:16.570824 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:16.571553 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:16.572199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:16.653122 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:16.660453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d5adc8b1-7fed-423f-a174-0e2e9eebb543 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1296 microversion: 2.1 time: 0.102906 Nov 16 16:24:16.661053 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 655/1196] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:16 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:17.678002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:17.678656 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:17.685394 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:17.685865 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:17.686658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:17.687082 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:17.898093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:17.905765 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7c99fbf9-7e83-4c50-bef5-8bca33f191f5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1363 microversion: 2.1 time: 0.231630 Nov 16 16:24:17.916330 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 542/1197] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:17 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:18.161433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-fefa6f6a-ec97-4423-bddd-b39c78a90ac3 req-aed7109b-6c36-4b20-a3c7-91b538c74b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807406d2-6025-4a97-a3ce-a61720020aef", "tag": "18c69252-e6f0-45a8-81a4-fdb0eed8a2fd"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:18.163198 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:18.163198 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:18.171611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-fefa6f6a-ec97-4423-bddd-b39c78a90ac3 req-aed7109b-6c36-4b20-a3c7-91b538c74b97 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:18.172283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-fefa6f6a-ec97-4423-bddd-b39c78a90ac3 req-aed7109b-6c36-4b20-a3c7-91b538c74b97 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:18.183815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-fefa6f6a-ec97-4423-bddd-b39c78a90ac3 req-aed7109b-6c36-4b20-a3c7-91b538c74b97 service nova] Creating event network-changed:18c69252-e6f0-45a8-81a4-fdb0eed8a2fd for instance 807406d2-6025-4a97-a3ce-a61720020aef on hv-cinder-78776 Nov 16 16:24:18.189714 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-fefa6f6a-ec97-4423-bddd-b39c78a90ac3 req-aed7109b-6c36-4b20-a3c7-91b538c74b97 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033675 Nov 16 16:24:18.190310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 656/1198] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:24:18.924542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:18.925246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:18.932169 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:18.932616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:18.933391 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:18.933851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:19.160457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:19.168203 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-af276e55-e01c-4f6b-8471-e8b86d2f2da2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1363 microversion: 2.1 time: 0.247826 Nov 16 16:24:19.168753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 543/1199] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:18 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:19.634623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:19.635548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:19.646124 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:19.646560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:19.647344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:19.647779 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:19.673302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:24:19.752950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4b793ce1-8da9-41bb-966b-2c2b043e8fcf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 204 len: 0 microversion: 2.1 time: 0.125717 Nov 16 16:24:19.753661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 657/1200] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:24:19 2021] DELETE /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:24:19.763258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:19.764110 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:19.771192 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:19.771643 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:19.772423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:19.772885 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:19.914982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:19.922966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bc892f7f-41c9-48a5-ab05-ff652158633c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1576 microversion: 2.1 time: 0.164528 Nov 16 16:24:19.923548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 544/1201] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:19 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:20.187494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:20.188227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:20.195567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:20.196064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:20.196998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:20.197461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:20.333862 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:20.345627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ade010c9-091a-4843-a9d8-7630764d8e46 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1363 microversion: 2.1 time: 0.162636 Nov 16 16:24:20.346493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 658/1202] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:20 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:20.944104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:20.945257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:20.955458 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:20.956191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:20.957447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:20.957951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:21.120566 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:21.132658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-53a7a72f-c211-45b4-800b-897cd13ca132 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1576 microversion: 2.1 time: 0.194348 Nov 16 16:24:21.133439 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 545/1203] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:20 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:21.368797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:21.369790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:21.376825 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:21.377269 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:21.378071 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:21.378517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:21.519138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:21.526600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-251039ec-a9ba-4765-83fc-7e9d097f6750 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1363 microversion: 2.1 time: 0.162357 Nov 16 16:24:21.527173 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 659/1204] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:21 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:22.154587 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:22.155280 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:22.162041 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:22.162563 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:22.163356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:22.163866 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:22.233761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:22.242371 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b00aa2a9-d872-4dfa-a184-1f5a1ffdce93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 200 len: 1509 microversion: 2.1 time: 0.091510 Nov 16 16:24:22.243088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 546/1205] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:22 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 1509 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:22.448129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-974e064a-c7bb-4cd1-90fd-d68db31e175f req-fd6ab0ab-64e3-490b-b934-437d5a4d8771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f3ec58d-75c6-423a-a57c-8769a0efd6b0", "name": "network-vif-deleted", "tag": "43f0a4a1-31b3-4518-b86e-e8daa712fca4"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:22.450539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:22.450539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:22.461105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-974e064a-c7bb-4cd1-90fd-d68db31e175f req-fd6ab0ab-64e3-490b-b934-437d5a4d8771 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:22.461542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-974e064a-c7bb-4cd1-90fd-d68db31e175f req-fd6ab0ab-64e3-490b-b934-437d5a4d8771 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:22.544137 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:22.544938 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:22.553040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:22.558775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:22.559922 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:22.560540 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:22.662501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-974e064a-c7bb-4cd1-90fd-d68db31e175f req-fd6ab0ab-64e3-490b-b934-437d5a4d8771 service nova] Creating event network-vif-deleted:43f0a4a1-31b3-4518-b86e-e8daa712fca4 for instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 on hv-cinder-78776 Nov 16 16:24:22.669536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-974e064a-c7bb-4cd1-90fd-d68db31e175f req-fd6ab0ab-64e3-490b-b934-437d5a4d8771 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225267 Nov 16 16:24:22.671087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 660/1206] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:24:22.718018 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:22.727035 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-942cfc0a-9fe8-474b-8d74-3c72de19554a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1363 microversion: 2.1 time: 0.186938 Nov 16 16:24:22.727921 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 547/1207] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:22 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:24:23.260004 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:23.260910 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:23.268248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:23.268780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:23.269635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:23.270154 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:23.284025 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] HTTP exception thrown: Instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 could not be found. Nov 16 16:24:23.284613 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Returning 404 to user: Instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:24:23.285417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0b765130-1a4f-4349-b5f7-d6b6113ca856 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 404 len: 111 microversion: 2.1 time: 0.029634 Nov 16 16:24:23.285944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 661/1208] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:23 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:24:23.335826 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1099654701", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1284105524", "security_groups": [{"name": "tempest-secgroup-smoke-251262737"}], "block_device_mapping_v2": [{"uuid": "db8eddda-6a58-4455-a3c6-59ee04e3ba16", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8ae9b94e-5cd6-4cea-ac09-979515cf0294"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:23.475492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] validate_networks() for [('8ae9b94e-5cd6-4cea-ac09-979515cf0294', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:24:23.485900 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-415bbdca-d2a2-4669-a320-e06fa25a2010 req-b6c721ae-0c08-4593-8b72-bfdcadf0b47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807406d2-6025-4a97-a3ce-a61720020aef", "name": "network-vif-plugged", "status": "completed", "tag": "18c69252-e6f0-45a8-81a4-fdb0eed8a2fd"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:23.488279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:23.488279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:23.499083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-415bbdca-d2a2-4669-a320-e06fa25a2010 req-b6c721ae-0c08-4593-8b72-bfdcadf0b47b service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:23.500066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-415bbdca-d2a2-4669-a320-e06fa25a2010 req-b6c721ae-0c08-4593-8b72-bfdcadf0b47b service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:23.513142 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-415bbdca-d2a2-4669-a320-e06fa25a2010 req-b6c721ae-0c08-4593-8b72-bfdcadf0b47b service nova] Creating event network-vif-plugged:18c69252-e6f0-45a8-81a4-fdb0eed8a2fd for instance 807406d2-6025-4a97-a3ce-a61720020aef on hv-cinder-78776 Nov 16 16:24:23.519627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-415bbdca-d2a2-4669-a320-e06fa25a2010 req-b6c721ae-0c08-4593-8b72-bfdcadf0b47b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038175 Nov 16 16:24:23.521148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 662/1209] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:24:23.745735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:23.746487 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:23.753177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:23.753631 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:23.754464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:23.755097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:23.996115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:24.004285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1eea6517-d234-4150-b287-629a15dd9227 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1363 microversion: 2.1 time: 0.262558 Nov 16 16:24:24.004983 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 663/1210] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:23 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:24.021791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:24:24.022215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:24:24.022714 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:24:24.023120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:24:24.023535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:24:24.032793 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:24.033245 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:24.034057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:24.034537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:24.051116 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:24:24.055261 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for user bd94e07e5a7d49398e9118053fc13c69 and project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:24:24.114673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:24:24.116931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db8eddda-6a58-4455-a3c6-59ee04e3ba16',volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:24:24.255616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7d961f1d-ec9c-4a6c-b0e0-2aaf70889c1e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.923914 Nov 16 16:24:24.256247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 548/1211] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:24:23 2021] POST /compute/v2.1/servers => generated 405 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:24:24.266677 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bb07d5e9-58ff-4d31-8ab3-70a851d8d2cf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:24.267278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bb07d5e9-58ff-4d31-8ab3-70a851d8d2cf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:24.322785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bb07d5e9-58ff-4d31-8ab3-70a851d8d2cf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:24.329179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bb07d5e9-58ff-4d31-8ab3-70a851d8d2cf tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1095 microversion: 2.1 time: 0.066387 Nov 16 16:24:24.329970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 664/1212] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:24 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:24:25.022047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:25.022767 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:25.030274 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:25.030807 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:25.031597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:25.032029 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:25.176211 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:25.184063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-40c40096-7daf-44e5-8a6c-a70b107ae168 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1363 microversion: 2.1 time: 0.166441 Nov 16 16:24:25.184657 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 549/1213] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:25 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:25.346351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:25.347654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:25.354536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:25.354985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:25.355750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:25.356185 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:25.434513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:25.441999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ff411f5d-ed01-4c31-b89f-081e233ff144 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1211 microversion: 2.1 time: 0.099419 Nov 16 16:24:25.442970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 665/1214] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:25 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:26.201464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:26.202165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:26.212297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:26.212754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:26.213537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:26.214152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:26.460224 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:26.460846 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:26.467511 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:26.467948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:26.468746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:26.469183 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:26.754770 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:26.763224 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2c5c47ac-ddc9-4b29-857d-4b3b1d4610a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1550 microversion: 2.1 time: 0.565580 Nov 16 16:24:26.763861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 550/1215] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:26 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1550 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:26.779887 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-887e2256-6aca-4596-bd3b-113a597ad945 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:26.780378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-887e2256-6aca-4596-bd3b-113a597ad945 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:26.787454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:26.787691 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-887e2256-6aca-4596-bd3b-113a597ad945 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:26.788123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-887e2256-6aca-4596-bd3b-113a597ad945 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:26.788966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-887e2256-6aca-4596-bd3b-113a597ad945 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:26.789406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-887e2256-6aca-4596-bd3b-113a597ad945 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:26.796417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c0900f80-5329-432c-ae2b-72d49b2c052b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.340042 Nov 16 16:24:26.797086 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 666/1216] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:26 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:26.939056 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-887e2256-6aca-4596-bd3b-113a597ad945 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162701 Nov 16 16:24:26.939655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 551/1217] 10.222.0.61 () {58 vars in 1274 bytes} [Tue Nov 16 16:24:26 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:24:27.113227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-6242ec70-0c29-4a76-bdb3-53f3b907d799 req-ba62ba71-478a-4eca-be41-305038b9a6dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172b0d0e-bc3e-43e0-9546-70e6878ac676", "tag": "64517ff5-93e6-4ccb-bf07-d2fe293d9e6c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:27.113227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:27.113227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:27.118026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-6242ec70-0c29-4a76-bdb3-53f3b907d799 req-ba62ba71-478a-4eca-be41-305038b9a6dd service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:27.118766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-6242ec70-0c29-4a76-bdb3-53f3b907d799 req-ba62ba71-478a-4eca-be41-305038b9a6dd service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:27.133251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-6242ec70-0c29-4a76-bdb3-53f3b907d799 req-ba62ba71-478a-4eca-be41-305038b9a6dd service nova] Creating event network-changed:64517ff5-93e6-4ccb-bf07-d2fe293d9e6c for instance 172b0d0e-bc3e-43e0-9546-70e6878ac676 on hv-cinder-78776 Nov 16 16:24:27.138880 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-6242ec70-0c29-4a76-bdb3-53f3b907d799 req-ba62ba71-478a-4eca-be41-305038b9a6dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033564 Nov 16 16:24:27.139943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 667/1218] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:24:27.814911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:27.815530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:27.821855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:27.822387 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:27.823254 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:27.823743 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:28.041371 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:28.049337 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-64285cd2-ab0b-445a-a23a-2062deb5a986 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.238806 Nov 16 16:24:28.049893 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 552/1219] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:27 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:28.200745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-28c3395e-ce13-4cc7-881f-d9f6a7a5dbf0 req-4b5d9aa5-c1d3-40cd-a091-da1203f69de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807406d2-6025-4a97-a3ce-a61720020aef", "tag": "18c69252-e6f0-45a8-81a4-fdb0eed8a2fd"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:28.202314 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:28.202314 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:24:28.207525 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3c3366fc-3fed-4ba4-b80a-a12895f90ba1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:28.208545 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3c3366fc-3fed-4ba4-b80a-a12895f90ba1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:28.210066 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-28c3395e-ce13-4cc7-881f-d9f6a7a5dbf0 req-4b5d9aa5-c1d3-40cd-a091-da1203f69de7 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:28.210584 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-28c3395e-ce13-4cc7-881f-d9f6a7a5dbf0 req-4b5d9aa5-c1d3-40cd-a091-da1203f69de7 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:28.214617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c3366fc-3fed-4ba4-b80a-a12895f90ba1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:28.215093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c3366fc-3fed-4ba4-b80a-a12895f90ba1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:28.215868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c3366fc-3fed-4ba4-b80a-a12895f90ba1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:28.218184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3c3366fc-3fed-4ba4-b80a-a12895f90ba1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:28.222326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-28c3395e-ce13-4cc7-881f-d9f6a7a5dbf0 req-4b5d9aa5-c1d3-40cd-a091-da1203f69de7 service nova] Creating event network-changed:18c69252-e6f0-45a8-81a4-fdb0eed8a2fd for instance 807406d2-6025-4a97-a3ce-a61720020aef on hv-cinder-78776 Nov 16 16:24:28.227589 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-28c3395e-ce13-4cc7-881f-d9f6a7a5dbf0 req-4b5d9aa5-c1d3-40cd-a091-da1203f69de7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030450 Nov 16 16:24:28.230305 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 553/1220] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:24:28.398420 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3c3366fc-3fed-4ba4-b80a-a12895f90ba1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.203743 Nov 16 16:24:28.399272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 668/1221] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:28 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:29.069510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:29.070213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:29.079119 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:29.079802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:29.081002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:29.081618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:29.229384 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:29.237821 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-88934a3b-6929-4601-ac6a-ca5195a8b6ba tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.173748 Nov 16 16:24:29.238452 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 554/1222] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:29 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:29.409880 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-db5bb9c2-4670-417e-ad34-f412adcced0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:29.410914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-db5bb9c2-4670-417e-ad34-f412adcced0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:29.418340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db5bb9c2-4670-417e-ad34-f412adcced0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:29.418831 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db5bb9c2-4670-417e-ad34-f412adcced0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:29.419654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db5bb9c2-4670-417e-ad34-f412adcced0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:29.420073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-db5bb9c2-4670-417e-ad34-f412adcced0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:29.490454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-db5bb9c2-4670-417e-ad34-f412adcced0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.084014 Nov 16 16:24:29.491278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 669/1223] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:29 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:30.257925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:30.258813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:30.266042 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:30.266523 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:30.267295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:30.267775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:30.404003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:30.414392 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-69e704cd-9820-4862-8da5-615962b94ee0 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.162386 Nov 16 16:24:30.414974 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 555/1224] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:30 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:30.507973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f2d0198a-bed2-4a5b-9094-41351425ea61 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:30.509640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f2d0198a-bed2-4a5b-9094-41351425ea61 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:30.521575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f2d0198a-bed2-4a5b-9094-41351425ea61 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:30.522405 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f2d0198a-bed2-4a5b-9094-41351425ea61 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:30.523235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f2d0198a-bed2-4a5b-9094-41351425ea61 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:30.523702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f2d0198a-bed2-4a5b-9094-41351425ea61 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:30.585657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f2d0198a-bed2-4a5b-9094-41351425ea61 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.084704 Nov 16 16:24:30.586240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 670/1225] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:30 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:31.431563 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:31.432138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:31.438922 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:31.439368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:31.440141 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:31.440581 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:31.592830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:31.596461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-aba64111-de2d-4d2d-afe7-6269daa4236f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:31.597479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-aba64111-de2d-4d2d-afe7-6269daa4236f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:31.600633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ea23189a-0f5a-49f6-8880-e8b994ffd635 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.172903 Nov 16 16:24:31.601229 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 556/1226] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:31 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:31.604543 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba64111-de2d-4d2d-afe7-6269daa4236f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:31.605005 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba64111-de2d-4d2d-afe7-6269daa4236f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:31.605771 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba64111-de2d-4d2d-afe7-6269daa4236f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:31.606192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-aba64111-de2d-4d2d-afe7-6269daa4236f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:31.666036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-aba64111-de2d-4d2d-afe7-6269daa4236f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.073394 Nov 16 16:24:31.666663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 671/1227] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:31 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:24:32.620320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:32.621247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:32.631647 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:32.632342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:32.633129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:32.633562 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:32.677481 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-dd330f0f-9d59-47d2-bb45-7867196a7c3a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:32.678533 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-dd330f0f-9d59-47d2-bb45-7867196a7c3a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:32.685895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dd330f0f-9d59-47d2-bb45-7867196a7c3a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:32.686343 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dd330f0f-9d59-47d2-bb45-7867196a7c3a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:32.687174 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dd330f0f-9d59-47d2-bb45-7867196a7c3a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:32.687607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dd330f0f-9d59-47d2-bb45-7867196a7c3a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:32.752083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-dd330f0f-9d59-47d2-bb45-7867196a7c3a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.078371 Nov 16 16:24:32.755329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 672/1228] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:32 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 16 16:24:32.775648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:32.783744 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6791e00b-32f5-459f-b2d4-574612d2e78e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.169827 Nov 16 16:24:32.784304 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 557/1229] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:32 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:33.770545 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e298ea88-bb60-4efd-bf60-f3f5c329d242 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:33.772565 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e298ea88-bb60-4efd-bf60-f3f5c329d242 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:33.780118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e298ea88-bb60-4efd-bf60-f3f5c329d242 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:33.780607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e298ea88-bb60-4efd-bf60-f3f5c329d242 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:33.781389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e298ea88-bb60-4efd-bf60-f3f5c329d242 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:33.781826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e298ea88-bb60-4efd-bf60-f3f5c329d242 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:33.800112 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:33.800718 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:33.807386 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:33.807830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:33.808621 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:33.809973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:33.854462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e298ea88-bb60-4efd-bf60-f3f5c329d242 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.092186 Nov 16 16:24:33.855190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 673/1230] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:33 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:33.948520 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:33.956652 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-34bcef86-8fda-43a0-9511-89fb60bb2426 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.160439 Nov 16 16:24:33.957221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 558/1231] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:33 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:34.870205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5551df00-2216-461e-8ffc-b52ed0622304 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:34.871901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5551df00-2216-461e-8ffc-b52ed0622304 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:34.882675 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5551df00-2216-461e-8ffc-b52ed0622304 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:34.883124 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5551df00-2216-461e-8ffc-b52ed0622304 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:34.883892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5551df00-2216-461e-8ffc-b52ed0622304 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:34.884326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5551df00-2216-461e-8ffc-b52ed0622304 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:34.950845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5551df00-2216-461e-8ffc-b52ed0622304 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.087532 Nov 16 16:24:34.951463 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 674/1232] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:34 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:34.972966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:34.973564 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:34.980578 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:34.981094 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:34.981806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:34.982487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:35.134221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:35.142456 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-10ad901c-aecd-4024-89f9-74d7aa83fb4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.173201 Nov 16 16:24:35.143048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 559/1233] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:34 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:35.964126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e4edd342-d99f-4217-9514-53eff80945e5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:35.965954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e4edd342-d99f-4217-9514-53eff80945e5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:35.973126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4edd342-d99f-4217-9514-53eff80945e5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:35.973580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4edd342-d99f-4217-9514-53eff80945e5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:35.974358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4edd342-d99f-4217-9514-53eff80945e5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:35.974811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4edd342-d99f-4217-9514-53eff80945e5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:36.049736 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e4edd342-d99f-4217-9514-53eff80945e5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.090505 Nov 16 16:24:36.050496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 675/1234] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:35 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:36.160628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:36.161197 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:36.168009 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:36.168458 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:36.169232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:36.169667 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:36.386550 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:36.394773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-98bd228a-7260-4f4c-bd84-6ef66485531e tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.237863 Nov 16 16:24:36.395362 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 560/1235] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:36 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:37.066552 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3cb37d21-96a2-4deb-9cb6-ccc6e8c797b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:37.068186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3cb37d21-96a2-4deb-9cb6-ccc6e8c797b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:37.080861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3cb37d21-96a2-4deb-9cb6-ccc6e8c797b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:37.081606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3cb37d21-96a2-4deb-9cb6-ccc6e8c797b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:37.083100 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3cb37d21-96a2-4deb-9cb6-ccc6e8c797b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:37.084118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3cb37d21-96a2-4deb-9cb6-ccc6e8c797b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:37.149055 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3cb37d21-96a2-4deb-9cb6-ccc6e8c797b0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.090103 Nov 16 16:24:37.150069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 676/1236] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:37 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:37.412263 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:37.412828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:37.419351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:37.419799 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:37.420583 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:37.420988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:37.558806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-cce1f1b6-d959-4110-96af-ff4749496300 req-6e0bc985-ec7f-4ccf-bbbc-b6e43db0f7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172b0d0e-bc3e-43e0-9546-70e6878ac676", "name": "network-vif-plugged", "status": "completed", "tag": "64517ff5-93e6-4ccb-bf07-d2fe293d9e6c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:37.561184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:37.561184 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:37.570002 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:37.572704 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-cce1f1b6-d959-4110-96af-ff4749496300 req-6e0bc985-ec7f-4ccf-bbbc-b6e43db0f7b9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:37.573145 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-cce1f1b6-d959-4110-96af-ff4749496300 req-6e0bc985-ec7f-4ccf-bbbc-b6e43db0f7b9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:37.577846 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c759ea11-9c7e-4013-ae72-989a0d3fdd0a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.169287 Nov 16 16:24:37.578685 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 561/1237] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:37 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:37.585686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-cce1f1b6-d959-4110-96af-ff4749496300 req-6e0bc985-ec7f-4ccf-bbbc-b6e43db0f7b9 service nova] Creating event network-vif-plugged:64517ff5-93e6-4ccb-bf07-d2fe293d9e6c for instance 172b0d0e-bc3e-43e0-9546-70e6878ac676 on hv-cinder-78776 Nov 16 16:24:37.591375 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-cce1f1b6-d959-4110-96af-ff4749496300 req-6e0bc985-ec7f-4ccf-bbbc-b6e43db0f7b9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038379 Nov 16 16:24:37.591950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 677/1238] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:24:38.162403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bd22b007-2590-4ad6-ae6d-7c055315dfec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:38.163288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bd22b007-2590-4ad6-ae6d-7c055315dfec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:38.169823 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd22b007-2590-4ad6-ae6d-7c055315dfec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:38.170268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd22b007-2590-4ad6-ae6d-7c055315dfec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:38.171091 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd22b007-2590-4ad6-ae6d-7c055315dfec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:38.171521 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd22b007-2590-4ad6-ae6d-7c055315dfec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:38.240418 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bd22b007-2590-4ad6-ae6d-7c055315dfec tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14 microversion: 2.1 time: 0.081749 Nov 16 16:24:38.241048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 562/1239] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:38 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:24:38.598606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:38.599431 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:38.609912 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:38.610649 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:38.611937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:38.612605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:38.754229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:38.767409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-80fd0b33-4f34-4adc-94d7-8e840d58bcdc tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1266 microversion: 2.1 time: 0.175076 Nov 16 16:24:38.767962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 678/1240] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:38 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:39.255580 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fdb72e06-fcec-4760-b119-ab43d8b55969 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:39.256880 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fdb72e06-fcec-4760-b119-ab43d8b55969 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:39.265957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdb72e06-fcec-4760-b119-ab43d8b55969 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:39.266412 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdb72e06-fcec-4760-b119-ab43d8b55969 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:39.267213 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdb72e06-fcec-4760-b119-ab43d8b55969 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:39.267636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdb72e06-fcec-4760-b119-ab43d8b55969 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:39.349327 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fdb72e06-fcec-4760-b119-ab43d8b55969 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 6451 microversion: 2.1 time: 0.100218 Nov 16 16:24:39.350104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 563/1241] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:39 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 6451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:39.786964 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:39.787700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:39.795019 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:39.795547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:39.796332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:39.796765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:39.936459 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:39.944461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-12a7c84d-1e94-4fcb-ae89-f7f4c57a8b8c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1452 microversion: 2.1 time: 0.162897 Nov 16 16:24:39.945029 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 679/1242] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:39 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:39.963493 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:39.964188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:39.971688 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:39.972127 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:39.972912 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:39.973335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:40.125910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:40.134173 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-024480df-7b12-4e8c-b9b0-059c2d5a05b7 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1452 microversion: 2.1 time: 0.175991 Nov 16 16:24:40.134777 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 564/1243] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:24:39 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:40.360474 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-adbdb43b-4337-4b61-8829-40802336b59f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:40.361390 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-adbdb43b-4337-4b61-8829-40802336b59f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:40.367570 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-adbdb43b-4337-4b61-8829-40802336b59f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:40.368113 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-adbdb43b-4337-4b61-8829-40802336b59f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:40.368901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-adbdb43b-4337-4b61-8829-40802336b59f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:40.369335 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-adbdb43b-4337-4b61-8829-40802336b59f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:40.444240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-adbdb43b-4337-4b61-8829-40802336b59f tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 14745 microversion: 2.1 time: 0.087360 Nov 16 16:24:40.444849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 680/1244] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:40 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 14745 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:41.456257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-40e83d4f-fb36-41dd-ba26-c88730de14a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:41.457172 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-40e83d4f-fb36-41dd-ba26-c88730de14a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:41.464451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40e83d4f-fb36-41dd-ba26-c88730de14a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:41.465058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40e83d4f-fb36-41dd-ba26-c88730de14a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:41.465900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40e83d4f-fb36-41dd-ba26-c88730de14a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:41.466334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40e83d4f-fb36-41dd-ba26-c88730de14a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:41.540183 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-40e83d4f-fb36-41dd-ba26-c88730de14a2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 18356 microversion: 2.1 time: 0.087489 Nov 16 16:24:41.541087 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 565/1245] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:41 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 18356 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:41.875251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-38795d0b-1edc-434f-b1e3-a3c740bf3aa0 req-a7d65547-5acc-4b2c-9331-985b9716a5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172b0d0e-bc3e-43e0-9546-70e6878ac676", "tag": "64517ff5-93e6-4ccb-bf07-d2fe293d9e6c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:41.877477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:24:41.877477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:24:41.885350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-38795d0b-1edc-434f-b1e3-a3c740bf3aa0 req-a7d65547-5acc-4b2c-9331-985b9716a5b6 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:41.886128 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-38795d0b-1edc-434f-b1e3-a3c740bf3aa0 req-a7d65547-5acc-4b2c-9331-985b9716a5b6 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:41.897760 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-38795d0b-1edc-434f-b1e3-a3c740bf3aa0 req-a7d65547-5acc-4b2c-9331-985b9716a5b6 service nova] Creating event network-changed:64517ff5-93e6-4ccb-bf07-d2fe293d9e6c for instance 172b0d0e-bc3e-43e0-9546-70e6878ac676 on hv-cinder-78776 Nov 16 16:24:41.902682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-38795d0b-1edc-434f-b1e3-a3c740bf3aa0 req-a7d65547-5acc-4b2c-9331-985b9716a5b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032133 Nov 16 16:24:41.903238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 681/1246] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:24:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:24:42.557345 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3791a071-2788-4597-844e-ee02a26d4b94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:42.559101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3791a071-2788-4597-844e-ee02a26d4b94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:42.569272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3791a071-2788-4597-844e-ee02a26d4b94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:42.569871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3791a071-2788-4597-844e-ee02a26d4b94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:42.571190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3791a071-2788-4597-844e-ee02a26d4b94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:42.571629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3791a071-2788-4597-844e-ee02a26d4b94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:42.654392 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3791a071-2788-4597-844e-ee02a26d4b94 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 19342 microversion: 2.1 time: 0.103945 Nov 16 16:24:42.655059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 566/1247] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:42 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 19342 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:43.671837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-36a9490b-1af6-4866-8b3c-2aa1b55cd674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:43.673304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-36a9490b-1af6-4866-8b3c-2aa1b55cd674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:43.682642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36a9490b-1af6-4866-8b3c-2aa1b55cd674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:43.683094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36a9490b-1af6-4866-8b3c-2aa1b55cd674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:43.683891 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36a9490b-1af6-4866-8b3c-2aa1b55cd674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:43.684322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-36a9490b-1af6-4866-8b3c-2aa1b55cd674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:43.769647 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-36a9490b-1af6-4866-8b3c-2aa1b55cd674 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 21935 microversion: 2.1 time: 0.105323 Nov 16 16:24:43.770501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 682/1248] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:43 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 21935 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:44.782624 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-60f6404a-cc4e-4248-a0ca-44b89979e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:44.783631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-60f6404a-cc4e-4248-a0ca-44b89979e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:44.791005 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60f6404a-cc4e-4248-a0ca-44b89979e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:44.791446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60f6404a-cc4e-4248-a0ca-44b89979e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:44.792198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60f6404a-cc4e-4248-a0ca-44b89979e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:44.792622 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-60f6404a-cc4e-4248-a0ca-44b89979e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:44.877070 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-60f6404a-cc4e-4248-a0ca-44b89979e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 23235 microversion: 2.1 time: 0.098070 Nov 16 16:24:44.877959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 567/1249] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:44 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 23235 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:45.895089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b143df7a-3a92-42ae-8347-0a9032ca169e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:45.896567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b143df7a-3a92-42ae-8347-0a9032ca169e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:45.904538 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b143df7a-3a92-42ae-8347-0a9032ca169e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:45.904988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b143df7a-3a92-42ae-8347-0a9032ca169e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:45.905763 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b143df7a-3a92-42ae-8347-0a9032ca169e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:45.906191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b143df7a-3a92-42ae-8347-0a9032ca169e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:45.987483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b143df7a-3a92-42ae-8347-0a9032ca169e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 24519 microversion: 2.1 time: 0.098660 Nov 16 16:24:45.988078 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 683/1250] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:45 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 24519 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:47.004173 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e25ff538-5ca1-466d-b61d-f7eb9c0561be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:47.005684 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e25ff538-5ca1-466d-b61d-f7eb9c0561be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:47.014526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25ff538-5ca1-466d-b61d-f7eb9c0561be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:47.014982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25ff538-5ca1-466d-b61d-f7eb9c0561be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:47.015751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25ff538-5ca1-466d-b61d-f7eb9c0561be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:47.016214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e25ff538-5ca1-466d-b61d-f7eb9c0561be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:47.092467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e25ff538-5ca1-466d-b61d-f7eb9c0561be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 26024 microversion: 2.1 time: 0.094301 Nov 16 16:24:47.093281 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 568/1251] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:46 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 26024 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:48.107161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f7cd78f6-59ee-4e37-b94e-c6bbf6ad9e18 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:48.108198 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f7cd78f6-59ee-4e37-b94e-c6bbf6ad9e18 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:48.115477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7cd78f6-59ee-4e37-b94e-c6bbf6ad9e18 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:48.115937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7cd78f6-59ee-4e37-b94e-c6bbf6ad9e18 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:48.116706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7cd78f6-59ee-4e37-b94e-c6bbf6ad9e18 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:48.117133 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f7cd78f6-59ee-4e37-b94e-c6bbf6ad9e18 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:48.206112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f7cd78f6-59ee-4e37-b94e-c6bbf6ad9e18 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 27107 microversion: 2.1 time: 0.102710 Nov 16 16:24:48.207160 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 684/1252] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:48 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 27107 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:49.222548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-190ce331-cef9-4ea3-94d9-d1f66d3ba9a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:49.223991 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-190ce331-cef9-4ea3-94d9-d1f66d3ba9a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:49.233932 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190ce331-cef9-4ea3-94d9-d1f66d3ba9a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:49.234576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190ce331-cef9-4ea3-94d9-d1f66d3ba9a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:49.235780 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190ce331-cef9-4ea3-94d9-d1f66d3ba9a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:49.236405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-190ce331-cef9-4ea3-94d9-d1f66d3ba9a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:49.325930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-190ce331-cef9-4ea3-94d9-d1f66d3ba9a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 27601 microversion: 2.1 time: 0.107794 Nov 16 16:24:49.327012 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 569/1253] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:49 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 27601 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:50.345772 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8929d21a-055b-423a-89fa-ed2ea5a2d372 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:50.347496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8929d21a-055b-423a-89fa-ed2ea5a2d372 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:50.357575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8929d21a-055b-423a-89fa-ed2ea5a2d372 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:50.358028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8929d21a-055b-423a-89fa-ed2ea5a2d372 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:50.359135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8929d21a-055b-423a-89fa-ed2ea5a2d372 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:50.359574 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8929d21a-055b-423a-89fa-ed2ea5a2d372 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:50.457427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8929d21a-055b-423a-89fa-ed2ea5a2d372 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 27845 microversion: 2.1 time: 0.118570 Nov 16 16:24:50.458457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 685/1254] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:50 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 27845 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:51.477459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-941910a5-02a1-4d3a-8f87-383a4649f472 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:51.479149 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-941910a5-02a1-4d3a-8f87-383a4649f472 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:51.490878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-941910a5-02a1-4d3a-8f87-383a4649f472 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:51.491621 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-941910a5-02a1-4d3a-8f87-383a4649f472 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:51.492904 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-941910a5-02a1-4d3a-8f87-383a4649f472 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:51.493626 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-941910a5-02a1-4d3a-8f87-383a4649f472 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:51.579207 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-941910a5-02a1-4d3a-8f87-383a4649f472 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28165 microversion: 2.1 time: 0.108083 Nov 16 16:24:51.580234 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 570/1255] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:51 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28165 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:52.598636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6ebf3bd8-3d6e-4311-856b-b8c716ce250e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:52.600264 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6ebf3bd8-3d6e-4311-856b-b8c716ce250e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:52.609624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6ebf3bd8-3d6e-4311-856b-b8c716ce250e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:52.610073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6ebf3bd8-3d6e-4311-856b-b8c716ce250e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:52.610899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6ebf3bd8-3d6e-4311-856b-b8c716ce250e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:52.611328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6ebf3bd8-3d6e-4311-856b-b8c716ce250e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:52.691792 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6ebf3bd8-3d6e-4311-856b-b8c716ce250e tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.099771 Nov 16 16:24:52.692352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 686/1256] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:52 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:53.708204 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a69cd002-c18a-4038-b2a5-d80e69d33b4d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:53.709837 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a69cd002-c18a-4038-b2a5-d80e69d33b4d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:53.719076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a69cd002-c18a-4038-b2a5-d80e69d33b4d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:53.719497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a69cd002-c18a-4038-b2a5-d80e69d33b4d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:53.720293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a69cd002-c18a-4038-b2a5-d80e69d33b4d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:53.720721 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a69cd002-c18a-4038-b2a5-d80e69d33b4d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:53.805178 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a69cd002-c18a-4038-b2a5-d80e69d33b4d tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.103622 Nov 16 16:24:53.805911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 571/1257] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:53 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:54.821236 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ced56874-04cc-4935-a619-323759204fb1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:54.822767 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ced56874-04cc-4935-a619-323759204fb1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:54.830598 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ced56874-04cc-4935-a619-323759204fb1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:54.831046 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ced56874-04cc-4935-a619-323759204fb1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:54.831844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ced56874-04cc-4935-a619-323759204fb1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:54.832279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ced56874-04cc-4935-a619-323759204fb1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:54.898782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ced56874-04cc-4935-a619-323759204fb1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.083607 Nov 16 16:24:54.899407 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 687/1258] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:54 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:55.915977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7007a898-ebc7-4580-bddb-6473888fb8be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:55.917893 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7007a898-ebc7-4580-bddb-6473888fb8be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:55.929347 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7007a898-ebc7-4580-bddb-6473888fb8be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:55.930097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7007a898-ebc7-4580-bddb-6473888fb8be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:55.931434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7007a898-ebc7-4580-bddb-6473888fb8be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:55.932162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7007a898-ebc7-4580-bddb-6473888fb8be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:56.007607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7007a898-ebc7-4580-bddb-6473888fb8be tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.098120 Nov 16 16:24:56.008664 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 572/1259] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:55 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:56.462860 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a47964f6-8217-4676-ad68-ce3072ae758a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:56.463467 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a47964f6-8217-4676-ad68-ce3072ae758a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:56.471283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a47964f6-8217-4676-ad68-ce3072ae758a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:56.471711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a47964f6-8217-4676-ad68-ce3072ae758a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:56.472480 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a47964f6-8217-4676-ad68-ce3072ae758a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:56.472902 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a47964f6-8217-4676-ad68-ce3072ae758a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:56.505016 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a47964f6-8217-4676-ad68-ce3072ae758a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments/812bc842-67ec-4dfc-9abb-f29e828d38b2" status: 200 len: 194 microversion: 2.20 time: 0.046475 Nov 16 16:24:56.505607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 688/1260] 10.222.0.61 () {60 vars in 1453 bytes} [Tue Nov 16 16:24:56 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments/812bc842-67ec-4dfc-9abb-f29e828d38b2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:56.577614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:56.578200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:56.585410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:56.585855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:56.586661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:56.587096 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:56.669853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lazy-loading 'services' on Instance uuid be607369-0706-46d3-9745-8e5549afb1ec {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:24:56.748454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-54a6becd-e3cc-4052-b884-cb3bfc6ebf39 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments/812bc842-67ec-4dfc-9abb-f29e828d38b2" status: 202 len: 0 microversion: 2.20 time: 0.176066 Nov 16 16:24:56.749026 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 573/1261] 10.222.0.61 () {60 vars in 1456 bytes} [Tue Nov 16 16:24:56 2021] DELETE /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments/812bc842-67ec-4dfc-9abb-f29e828d38b2 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:24:56.757482 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f36426b7-94bc-4e11-8fb5-900c2cfe1f91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:56.758413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f36426b7-94bc-4e11-8fb5-900c2cfe1f91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:56.765108 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f36426b7-94bc-4e11-8fb5-900c2cfe1f91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:56.765574 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f36426b7-94bc-4e11-8fb5-900c2cfe1f91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:56.766359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f36426b7-94bc-4e11-8fb5-900c2cfe1f91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:56.766799 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f36426b7-94bc-4e11-8fb5-900c2cfe1f91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:56.799762 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f36426b7-94bc-4e11-8fb5-900c2cfe1f91 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046175 Nov 16 16:24:56.800344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 689/1262] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Nov 16 16:24:56 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:57.023400 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d3d7a45d-a8e6-47f5-bea1-10c1dae62183 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:57.024389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d3d7a45d-a8e6-47f5-bea1-10c1dae62183 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:57.031421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d7a45d-a8e6-47f5-bea1-10c1dae62183 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:57.031870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d7a45d-a8e6-47f5-bea1-10c1dae62183 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:57.032610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d7a45d-a8e6-47f5-bea1-10c1dae62183 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:57.033047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3d7a45d-a8e6-47f5-bea1-10c1dae62183 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:57.101595 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d3d7a45d-a8e6-47f5-bea1-10c1dae62183 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.082738 Nov 16 16:24:57.102196 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 574/1263] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:57 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:57.812341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6bb3be69-0b22-46d0-889d-ddfaff4999ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:57.813321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6bb3be69-0b22-46d0-889d-ddfaff4999ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:57.822982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6bb3be69-0b22-46d0-889d-ddfaff4999ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:57.823600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6bb3be69-0b22-46d0-889d-ddfaff4999ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:57.826650 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6bb3be69-0b22-46d0-889d-ddfaff4999ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:57.828176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6bb3be69-0b22-46d0-889d-ddfaff4999ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:57.862414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6bb3be69-0b22-46d0-889d-ddfaff4999ce tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054223 Nov 16 16:24:57.862991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 690/1264] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Nov 16 16:24:57 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:24:57.923827 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:57.924439 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:57.934699 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:57.935152 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:57.935934 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:57.936366 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:57.962102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:24:58.056459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9ebc8813-bb0d-4f4b-b816-7e8d65604bc7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 204 len: 0 microversion: 2.20 time: 0.139189 Nov 16 16:24:58.057189 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 575/1265] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Nov 16 16:24:57 2021] DELETE /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:24:58.065531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:58.066056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:58.072684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:58.073125 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:58.073890 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:58.074351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:58.114036 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-582c2322-8fef-4c0c-9841-68844eb19fc2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:58.115106 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-582c2322-8fef-4c0c-9841-68844eb19fc2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:58.121794 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-582c2322-8fef-4c0c-9841-68844eb19fc2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:58.122239 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-582c2322-8fef-4c0c-9841-68844eb19fc2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:58.123081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-582c2322-8fef-4c0c-9841-68844eb19fc2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:58.123513 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-582c2322-8fef-4c0c-9841-68844eb19fc2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:58.192443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-582c2322-8fef-4c0c-9841-68844eb19fc2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.082426 Nov 16 16:24:58.193103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 576/1266] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:58 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:24:58.216423 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:58.225710 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:58.227196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:58.228355 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b0c864be-0b49-4d47-8b5f-c94fb415b1bf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.166816 Nov 16 16:24:58.228908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 691/1267] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:24:58 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:24:59.210318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-62578bd7-308a-434c-8a08-1e2b2edcab73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:24:59.212061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-62578bd7-308a-434c-8a08-1e2b2edcab73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:59.224026 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62578bd7-308a-434c-8a08-1e2b2edcab73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:59.224766 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62578bd7-308a-434c-8a08-1e2b2edcab73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:59.226085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62578bd7-308a-434c-8a08-1e2b2edcab73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:59.226834 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-62578bd7-308a-434c-8a08-1e2b2edcab73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:59.248214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:24:59.249594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:24:59.256439 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:59.256994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:59.258279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:24:59.258799 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:24:59.300036 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-62578bd7-308a-434c-8a08-1e2b2edcab73 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.096546 Nov 16 16:24:59.300655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 577/1268] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:24:59 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:24:59.416695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:59.425659 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:59.427198 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:24:59.428357 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-33dba44d-8bc2-438d-aba9-3862e3820421 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.184443 Nov 16 16:24:59.428951 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 692/1269] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:24:59 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:00.314617 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-08d6fc7b-9f80-4306-bb24-08efbeeb40f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:00.315775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-08d6fc7b-9f80-4306-bb24-08efbeeb40f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:00.322949 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d6fc7b-9f80-4306-bb24-08efbeeb40f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:00.323408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d6fc7b-9f80-4306-bb24-08efbeeb40f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:00.324241 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d6fc7b-9f80-4306-bb24-08efbeeb40f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:00.324681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-08d6fc7b-9f80-4306-bb24-08efbeeb40f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:00.399934 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-08d6fc7b-9f80-4306-bb24-08efbeeb40f7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.090357 Nov 16 16:25:00.400568 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 578/1270] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:00 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:00.449089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:00.449765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:00.456571 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:00.457017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:00.457804 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:00.458236 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:00.702876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:00.710960 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:00.712425 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:00.713635 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-619cdfc9-7457-4798-b8e8-c34ec1f3c07b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1724 microversion: 2.20 time: 0.268373 Nov 16 16:25:00.714191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 693/1271] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:00 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:01.387062 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-4260a944-3635-4a77-9688-0b39779dcd46 req-435dae8e-7e2d-4e04-a835-e14af74f9a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be607369-0706-46d3-9745-8e5549afb1ec", "name": "network-vif-deleted", "tag": "8b0ab530-8322-4d7c-a925-57b347432f28"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:01.388963 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:25:01.388963 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:25:01.398937 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-4260a944-3635-4a77-9688-0b39779dcd46 req-435dae8e-7e2d-4e04-a835-e14af74f9a3f service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:01.399376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-4260a944-3635-4a77-9688-0b39779dcd46 req-435dae8e-7e2d-4e04-a835-e14af74f9a3f service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:01.412217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-97fac7db-5451-44fc-9ed9-cb17511e8063 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:01.413136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-4260a944-3635-4a77-9688-0b39779dcd46 req-435dae8e-7e2d-4e04-a835-e14af74f9a3f service nova] Creating event network-vif-deleted:8b0ab530-8322-4d7c-a925-57b347432f28 for instance be607369-0706-46d3-9745-8e5549afb1ec on hv-cinder-78776 Nov 16 16:25:01.413261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-97fac7db-5451-44fc-9ed9-cb17511e8063 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:01.418492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-4260a944-3635-4a77-9688-0b39779dcd46 req-435dae8e-7e2d-4e04-a835-e14af74f9a3f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035815 Nov 16 16:25:01.419292 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 579/1272] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:25:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:01.430055 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97fac7db-5451-44fc-9ed9-cb17511e8063 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:01.431261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97fac7db-5451-44fc-9ed9-cb17511e8063 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:01.432092 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97fac7db-5451-44fc-9ed9-cb17511e8063 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:01.432757 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97fac7db-5451-44fc-9ed9-cb17511e8063 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:01.507462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-97fac7db-5451-44fc-9ed9-cb17511e8063 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.099103 Nov 16 16:25:01.509077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 694/1273] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:01 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:25:01.735215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:01.735903 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:01.743049 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:01.743420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:01.744184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:01.744580 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:01.780207 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:01.780629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:01.781483 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lazy-loading 'fault' on Instance uuid be607369-0706-46d3-9745-8e5549afb1ec {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:25:01.823438 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:01.832755 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:01.834737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:01.835928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-10e74d55-ef5c-4ae6-8543-6fb75ffe3f15 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 200 len: 1371 microversion: 2.20 time: 0.105108 Nov 16 16:25:01.836485 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 580/1274] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:01 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:25:02.525244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1ee6abcf-a650-4c63-960a-691d4461abfe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:02.527138 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1ee6abcf-a650-4c63-960a-691d4461abfe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:02.535932 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ee6abcf-a650-4c63-960a-691d4461abfe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:02.536397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ee6abcf-a650-4c63-960a-691d4461abfe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:02.537168 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ee6abcf-a650-4c63-960a-691d4461abfe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:02.537594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1ee6abcf-a650-4c63-960a-691d4461abfe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:02.602509 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1ee6abcf-a650-4c63-960a-691d4461abfe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.083903 Nov 16 16:25:02.603058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 695/1275] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:02 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:02.858675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:02.859218 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:02.866075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:02.866504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:02.867304 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:02.867728 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:02.881229 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] HTTP exception thrown: Instance be607369-0706-46d3-9745-8e5549afb1ec could not be found. Nov 16 16:25:02.881807 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Returning 404 to user: Instance be607369-0706-46d3-9745-8e5549afb1ec could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:25:02.882774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9d8dc7e4-db53-4fbb-b78e-067669f98c11 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 404 len: 111 microversion: 2.20 time: 0.029972 Nov 16 16:25:02.883270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 581/1276] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:02 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:25:02.895520 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d2e4d41a-5b6f-4a5c-8454-1d5544356db1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '.version_select at 0x7f3ec360aa60>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:02.925073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d2e4d41a-5b6f-4a5c-8454-1d5544356db1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750498430" status: 204 len: 0 microversion: 2.20 time: 0.035897 Nov 16 16:25:02.925624 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 696/1277] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Nov 16 16:25:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1750498430 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:25:03.608930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2be95151-a684-4b30-899c-bd20b1cc311b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'create', calling method: .version_select at 0x7f3ec36d00d0>, body: {"keypair": {"name": "tempest-keypair-1535398336"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:03.614351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a21b0336-3394-491d-bfcf-bc821b54e3f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:03.616035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a21b0336-3394-491d-bfcf-bc821b54e3f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:03.622812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a21b0336-3394-491d-bfcf-bc821b54e3f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:03.623264 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a21b0336-3394-491d-bfcf-bc821b54e3f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:03.624401 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a21b0336-3394-491d-bfcf-bc821b54e3f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:03.624552 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-2be95151-a684-4b30-899c-bd20b1cc311b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:25:03.624838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a21b0336-3394-491d-bfcf-bc821b54e3f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:03.628871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-2be95151-a684-4b30-899c-bd20b1cc311b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for user 389db5ee5d9d4d59bf15b3b4001bfce1 and project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:25:03.687518 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a21b0336-3394-491d-bfcf-bc821b54e3f4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28207 microversion: 2.1 time: 0.076517 Nov 16 16:25:03.688041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 697/1278] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:03 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28207 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:03.831636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-2be95151-a684-4b30-899c-bd20b1cc311b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:25:03.836548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-2be95151-a684-4b30-899c-bd20b1cc311b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for user 389db5ee5d9d4d59bf15b3b4001bfce1 and project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'key_pairs'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:25:03.852683 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2be95151-a684-4b30-899c-bd20b1cc311b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.247859 Nov 16 16:25:03.853312 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 582/1279] 10.222.0.61 () {62 vars in 1198 bytes} [Tue Nov 16 16:25:03 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:25:04.699760 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d8bc7fdc-de71-488b-b156-330d5c6a888a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:04.700822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d8bc7fdc-de71-488b-b156-330d5c6a888a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:04.708389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fdc-de71-488b-b156-330d5c6a888a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:04.708839 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fdc-de71-488b-b156-330d5c6a888a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:04.709628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fdc-de71-488b-b156-330d5c6a888a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:04.710065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8bc7fdc-de71-488b-b156-330d5c6a888a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:04.796724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d8bc7fdc-de71-488b-b156-330d5c6a888a tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28352 microversion: 2.1 time: 0.101168 Nov 16 16:25:04.797400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 698/1280] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:04 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:05.422668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-812990149", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9573b352-3f35-4265-9888-1c7a2a928315"}], "security_groups": [{"name": "tempest-securitygroup--1436852450"}], "key_name": "tempest-keypair-1535398336", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:05.524648 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] validate_networks() for [('9573b352-3f35-4265-9888-1c7a2a928315', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:25:05.809421 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b64b4122-1f5c-448b-94d1-4e26baf480ea tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:05.810440 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b64b4122-1f5c-448b-94d1-4e26baf480ea tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:05.817792 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b64b4122-1f5c-448b-94d1-4e26baf480ea tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:05.818240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b64b4122-1f5c-448b-94d1-4e26baf480ea tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:05.819098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b64b4122-1f5c-448b-94d1-4e26baf480ea tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:05.819532 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b64b4122-1f5c-448b-94d1-4e26baf480ea tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:05.903332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b64b4122-1f5c-448b-94d1-4e26baf480ea tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28498 microversion: 2.1 time: 0.097846 Nov 16 16:25:05.904009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 699/1281] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:05 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28498 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:05.930626 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:25:05.931041 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:25:05.931509 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:25:05.931910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:25:05.932341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:25:05.941335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:05.941776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:05.942620 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:05.943046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:05.959631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:25:05.963456 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Getting quotas for user 389db5ee5d9d4d59bf15b3b4001bfce1 and project b74019a568aa4ba6aa5af9147f1e9c72. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:25:05.973837 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:25:05.976177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:25:06.034772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9401aa48-bf57-43e0-95fb-a5ac21333dc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.616466 Nov 16 16:25:06.035422 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 583/1282] 10.222.0.61 () {62 vars in 1187 bytes} [Tue Nov 16 16:25:05 2021] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 16 16:25:06.047640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-79a244bd-5a6d-483f-9b6f-c513d80fdc9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:06.048431 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-79a244bd-5a6d-483f-9b6f-c513d80fdc9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:06.103709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-79a244bd-5a6d-483f-9b6f-c513d80fdc9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:06.111240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-79a244bd-5a6d-483f-9b6f-c513d80fdc9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:06.112717 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-79a244bd-5a6d-483f-9b6f-c513d80fdc9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:06.113833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-79a244bd-5a6d-483f-9b6f-c513d80fdc9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1281 microversion: 2.20 time: 0.070549 Nov 16 16:25:06.114548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 700/1283] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:06 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:06.921414 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-84f63e13-b44d-4b10-ba1d-7a97e2f78680 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:06.923105 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-84f63e13-b44d-4b10-ba1d-7a97e2f78680 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:06.934603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84f63e13-b44d-4b10-ba1d-7a97e2f78680 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:06.935355 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84f63e13-b44d-4b10-ba1d-7a97e2f78680 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:06.936544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84f63e13-b44d-4b10-ba1d-7a97e2f78680 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:06.936984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-84f63e13-b44d-4b10-ba1d-7a97e2f78680 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:07.015629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-84f63e13-b44d-4b10-ba1d-7a97e2f78680 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.100561 Nov 16 16:25:07.019755 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 584/1284] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:06 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:07.131519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:07.132412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:07.140690 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:07.141119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:07.142204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:07.142621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:07.214706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:07.223091 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:07.224557 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:07.225682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0fffbcec-9d10-44a9-9006-86ce1a8d6c3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1351 microversion: 2.20 time: 0.098046 Nov 16 16:25:07.226235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 701/1285] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:07 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:25:08.028794 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5dc8ac30-1f80-44ad-a5fc-8181126538f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:08.031325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5dc8ac30-1f80-44ad-a5fc-8181126538f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:08.038948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5dc8ac30-1f80-44ad-a5fc-8181126538f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:08.039395 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5dc8ac30-1f80-44ad-a5fc-8181126538f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:08.040194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5dc8ac30-1f80-44ad-a5fc-8181126538f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:08.040628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5dc8ac30-1f80-44ad-a5fc-8181126538f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:08.111774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5dc8ac30-1f80-44ad-a5fc-8181126538f0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.087269 Nov 16 16:25:08.115809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 585/1286] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:08 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:08.245075 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:08.246293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:08.252804 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:08.253243 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:08.254011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:08.254446 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:08.476897 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:08.485197 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:08.486719 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:08.487813 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-48917982-3fb9-4baa-8af3-eddd89646a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1407 microversion: 2.20 time: 0.246451 Nov 16 16:25:08.488357 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 702/1287] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:08 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:08.583899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-947994e4-a811-41e3-84aa-db0cc89e7a46 req-9d1ddd53-5468-42ad-8536-2b3740845aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee31bfd-6eb9-42f2-86b4-f6de92582bd6", "tag": "1371c66f-3f9f-467f-8620-20b01c600c30"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:08.585661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:25:08.585661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:25:08.595775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-947994e4-a811-41e3-84aa-db0cc89e7a46 req-9d1ddd53-5468-42ad-8536-2b3740845aa9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:08.596658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-947994e4-a811-41e3-84aa-db0cc89e7a46 req-9d1ddd53-5468-42ad-8536-2b3740845aa9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:08.611596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-947994e4-a811-41e3-84aa-db0cc89e7a46 req-9d1ddd53-5468-42ad-8536-2b3740845aa9 service nova] Creating event network-changed:1371c66f-3f9f-467f-8620-20b01c600c30 for instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 on hv-cinder-78776 Nov 16 16:25:08.617629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-947994e4-a811-41e3-84aa-db0cc89e7a46 req-9d1ddd53-5468-42ad-8536-2b3740845aa9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037230 Nov 16 16:25:08.618299 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 586/1288] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:25:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:25:09.123474 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-391cd2bd-6ed8-4238-8150-45d930508597 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:09.124773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-391cd2bd-6ed8-4238-8150-45d930508597 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:09.132009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391cd2bd-6ed8-4238-8150-45d930508597 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:09.132329 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391cd2bd-6ed8-4238-8150-45d930508597 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:09.133135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391cd2bd-6ed8-4238-8150-45d930508597 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:09.133597 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391cd2bd-6ed8-4238-8150-45d930508597 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:09.452233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-391cd2bd-6ed8-4238-8150-45d930508597 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.332422 Nov 16 16:25:09.453246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 703/1289] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:09 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:09.507750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:09.508436 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:09.515634 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:09.516089 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:09.516879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:09.517300 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:09.681944 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:09.693436 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:09.695675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:09.697357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-390a2188-a07a-4811-b53f-6e6f905c89d0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1407 microversion: 2.20 time: 0.193980 Nov 16 16:25:09.698075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 587/1290] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:09 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:10.469530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ab39bb72-5b89-41a6-a3e8-b46ca85d3635 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:10.471208 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ab39bb72-5b89-41a6-a3e8-b46ca85d3635 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:10.482878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab39bb72-5b89-41a6-a3e8-b46ca85d3635 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:10.483387 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab39bb72-5b89-41a6-a3e8-b46ca85d3635 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:10.484201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab39bb72-5b89-41a6-a3e8-b46ca85d3635 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:10.484641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ab39bb72-5b89-41a6-a3e8-b46ca85d3635 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:10.553908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ab39bb72-5b89-41a6-a3e8-b46ca85d3635 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.091216 Nov 16 16:25:10.554619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 704/1291] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:10 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:10.719804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:10.720475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:10.729009 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:10.729562 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:10.730570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:10.731115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:10.884617 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:10.894181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:10.895702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:10.896806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-85fefbd3-6987-4738-8f3a-d9596a67003f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1407 microversion: 2.20 time: 0.182788 Nov 16 16:25:10.897356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 588/1292] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:10 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:25:11.569261 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d09b8dfe-3c31-4c2b-84f6-b750a7c6d620 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:11.570415 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d09b8dfe-3c31-4c2b-84f6-b750a7c6d620 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:11.578636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09b8dfe-3c31-4c2b-84f6-b750a7c6d620 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:11.579089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09b8dfe-3c31-4c2b-84f6-b750a7c6d620 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:11.579932 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09b8dfe-3c31-4c2b-84f6-b750a7c6d620 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:11.580370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d09b8dfe-3c31-4c2b-84f6-b750a7c6d620 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:11.650479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d09b8dfe-3c31-4c2b-84f6-b750a7c6d620 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.085443 Nov 16 16:25:11.654980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 705/1293] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:11 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:11.915190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:11.915805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:11.923131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:11.923583 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:11.924385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:11.924819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:12.077464 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:12.089415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:12.090959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:12.092271 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c986243e-b9a0-4567-8dfd-80f3ceaa12a4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1407 microversion: 2.20 time: 0.180739 Nov 16 16:25:12.092823 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 589/1294] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:11 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:12.663410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c7287956-c6d6-4d24-94a0-d641d34558e3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:12.664406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c7287956-c6d6-4d24-94a0-d641d34558e3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:12.671916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7287956-c6d6-4d24-94a0-d641d34558e3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:12.672359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7287956-c6d6-4d24-94a0-d641d34558e3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:12.673142 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7287956-c6d6-4d24-94a0-d641d34558e3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:12.673570 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c7287956-c6d6-4d24-94a0-d641d34558e3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:12.740938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c7287956-c6d6-4d24-94a0-d641d34558e3 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.081267 Nov 16 16:25:12.741755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 706/1295] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:12 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:13.116958 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:13.117939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:13.129317 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:13.130069 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:13.131407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:13.132131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:13.277138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:13.289602 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:13.291681 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:13.293288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd450aba-65d9-4615-89d0-31a6d4eeb504 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1407 microversion: 2.20 time: 0.182534 Nov 16 16:25:13.294095 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 590/1296] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:13 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:13.754330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8ff6a481-18b6-410e-bfec-a9216ad6557c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:13.755933 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8ff6a481-18b6-410e-bfec-a9216ad6557c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:13.756531 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-63f533d2-938c-4b6a-b435-53ff5a821f54 req-bb00ce7d-05f1-4c9e-a9ad-417a01bf30fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee31bfd-6eb9-42f2-86b4-f6de92582bd6", "name": "network-vif-plugged", "status": "completed", "tag": "1371c66f-3f9f-467f-8620-20b01c600c30"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:13.758161 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:25:13.758161 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:25:13.764228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ff6a481-18b6-410e-bfec-a9216ad6557c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:13.764746 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ff6a481-18b6-410e-bfec-a9216ad6557c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:13.765566 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ff6a481-18b6-410e-bfec-a9216ad6557c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:13.765988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ff6a481-18b6-410e-bfec-a9216ad6557c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:13.767145 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-63f533d2-938c-4b6a-b435-53ff5a821f54 req-bb00ce7d-05f1-4c9e-a9ad-417a01bf30fb service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:13.767642 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-63f533d2-938c-4b6a-b435-53ff5a821f54 req-bb00ce7d-05f1-4c9e-a9ad-417a01bf30fb service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:13.784530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-63f533d2-938c-4b6a-b435-53ff5a821f54 req-bb00ce7d-05f1-4c9e-a9ad-417a01bf30fb service nova] Creating event network-vif-plugged:1371c66f-3f9f-467f-8620-20b01c600c30 for instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 on hv-cinder-78776 Nov 16 16:25:13.789522 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-63f533d2-938c-4b6a-b435-53ff5a821f54 req-bb00ce7d-05f1-4c9e-a9ad-417a01bf30fb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037039 Nov 16 16:25:13.790888 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 591/1297] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:25:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:25:13.845159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8ff6a481-18b6-410e-bfec-a9216ad6557c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.095066 Nov 16 16:25:13.846764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 707/1298] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:13 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:25:14.314176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:14.314882 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:14.322790 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:14.323292 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:14.324145 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:14.324640 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:14.480106 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:14.488148 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:14.489627 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:14.490774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ffeee3a0-d388-4e80-9dc7-a5130c072406 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1407 microversion: 2.20 time: 0.181632 Nov 16 16:25:14.491306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 592/1299] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:14 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:14.861377 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a3d4b931-b59d-46e1-8171-e28749318650 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:14.862661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a3d4b931-b59d-46e1-8171-e28749318650 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:14.871153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3d4b931-b59d-46e1-8171-e28749318650 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:14.871702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3d4b931-b59d-46e1-8171-e28749318650 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:14.872599 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3d4b931-b59d-46e1-8171-e28749318650 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:14.873154 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a3d4b931-b59d-46e1-8171-e28749318650 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:14.980675 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a3d4b931-b59d-46e1-8171-e28749318650 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.124495 Nov 16 16:25:14.981517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 708/1300] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:14 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:15.509174 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:15.510554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:15.527629 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:15.528063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:15.528904 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:15.529336 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:15.683111 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:15.692414 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:15.693906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:15.695055 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5d7a44a2-422b-411c-b34c-87e02174b0a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1407 microversion: 2.20 time: 0.190215 Nov 16 16:25:15.695607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 593/1301] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:15 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:15.997380 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-29a8a0d3-049d-435b-bf7b-553db370e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:15.998582 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-29a8a0d3-049d-435b-bf7b-553db370e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:16.008169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29a8a0d3-049d-435b-bf7b-553db370e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:16.008627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29a8a0d3-049d-435b-bf7b-553db370e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:16.009669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29a8a0d3-049d-435b-bf7b-553db370e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:16.010756 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-29a8a0d3-049d-435b-bf7b-553db370e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:16.080815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-29a8a0d3-049d-435b-bf7b-553db370e935 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.087313 Nov 16 16:25:16.081455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 709/1302] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:15 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:16.716264 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:16.716971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:16.726113 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:16.726759 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:16.727781 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:16.728351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:16.866591 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:16.877716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:16.879224 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:16.880369 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-738352ab-8414-4f41-9df7-0771c834ff76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1600 microversion: 2.20 time: 0.169344 Nov 16 16:25:16.880912 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 594/1303] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:25:16 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:16.899273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c82cf33e-c263-495b-9d66-b27c16ae3723 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:16.899854 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c82cf33e-c263-495b-9d66-b27c16ae3723 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:16.907246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c82cf33e-c263-495b-9d66-b27c16ae3723 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:16.907684 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c82cf33e-c263-495b-9d66-b27c16ae3723 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:16.908458 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c82cf33e-c263-495b-9d66-b27c16ae3723 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:16.908871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c82cf33e-c263-495b-9d66-b27c16ae3723 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:17.004341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c82cf33e-c263-495b-9d66-b27c16ae3723 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.109192 Nov 16 16:25:17.004947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 710/1304] 10.222.0.61 () {60 vars in 1315 bytes} [Tue Nov 16 16:25:16 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:17.093121 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9a888d75-cc58-46eb-8eda-da81075c1c45 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:17.094210 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9a888d75-cc58-46eb-8eda-da81075c1c45 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:17.100731 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a888d75-cc58-46eb-8eda-da81075c1c45 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:17.101194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a888d75-cc58-46eb-8eda-da81075c1c45 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:17.101977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a888d75-cc58-46eb-8eda-da81075c1c45 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:17.102410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9a888d75-cc58-46eb-8eda-da81075c1c45 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:17.164678 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9a888d75-cc58-46eb-8eda-da81075c1c45 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.075331 Nov 16 16:25:17.165320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 595/1305] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:17 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:17.965132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bdbe6087-eb8d-4ed1-bf6d-3dec2545ae1c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:17.970779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-fa436dcb-f5b6-41f2-bb69-d5a709ffd5e1 req-cbd5a911-ffc7-4cbf-a03d-2b9d7ecf603a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ee31bfd-6eb9-42f2-86b4-f6de92582bd6", "tag": "1371c66f-3f9f-467f-8620-20b01c600c30"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:17.972159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bdbe6087-eb8d-4ed1-bf6d-3dec2545ae1c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:17.973342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:25:17.973342 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:25:17.979882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdbe6087-eb8d-4ed1-bf6d-3dec2545ae1c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:17.980353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdbe6087-eb8d-4ed1-bf6d-3dec2545ae1c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:17.983148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdbe6087-eb8d-4ed1-bf6d-3dec2545ae1c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:17.983148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bdbe6087-eb8d-4ed1-bf6d-3dec2545ae1c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:17.983393 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-fa436dcb-f5b6-41f2-bb69-d5a709ffd5e1 req-cbd5a911-ffc7-4cbf-a03d-2b9d7ecf603a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:17.983393 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-fa436dcb-f5b6-41f2-bb69-d5a709ffd5e1 req-cbd5a911-ffc7-4cbf-a03d-2b9d7ecf603a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:17.993913 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-fa436dcb-f5b6-41f2-bb69-d5a709ffd5e1 req-cbd5a911-ffc7-4cbf-a03d-2b9d7ecf603a service nova] Creating event network-changed:1371c66f-3f9f-467f-8620-20b01c600c30 for instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 on hv-cinder-78776 Nov 16 16:25:17.998996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-fa436dcb-f5b6-41f2-bb69-d5a709ffd5e1 req-cbd5a911-ffc7-4cbf-a03d-2b9d7ecf603a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032087 Nov 16 16:25:18.000179 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 596/1306] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:25:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:18.043540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bdbe6087-eb8d-4ed1-bf6d-3dec2545ae1c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.082719 Nov 16 16:25:18.047124 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 711/1307] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:17 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:18.177984 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d2c3e2b9-f815-4a2a-a5f7-31f427134df0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:18.179004 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d2c3e2b9-f815-4a2a-a5f7-31f427134df0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:18.185590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2c3e2b9-f815-4a2a-a5f7-31f427134df0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:18.186046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2c3e2b9-f815-4a2a-a5f7-31f427134df0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:18.186858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2c3e2b9-f815-4a2a-a5f7-31f427134df0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:18.187287 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d2c3e2b9-f815-4a2a-a5f7-31f427134df0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:18.256652 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d2c3e2b9-f815-4a2a-a5f7-31f427134df0 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.083132 Nov 16 16:25:18.258421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 597/1308] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:18 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:19.055308 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2d68f629-3782-42f0-a1cd-f07d51c94d99 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:19.056304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2d68f629-3782-42f0-a1cd-f07d51c94d99 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:19.067139 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d68f629-3782-42f0-a1cd-f07d51c94d99 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:19.067601 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d68f629-3782-42f0-a1cd-f07d51c94d99 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:19.068421 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d68f629-3782-42f0-a1cd-f07d51c94d99 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:19.068848 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2d68f629-3782-42f0-a1cd-f07d51c94d99 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:19.130969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2d68f629-3782-42f0-a1cd-f07d51c94d99 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.079545 Nov 16 16:25:19.134175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 712/1309] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:19 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:19.270009 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c08db848-07ca-4a92-9787-b8722bd3cef2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:19.271106 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c08db848-07ca-4a92-9787-b8722bd3cef2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:19.278504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c08db848-07ca-4a92-9787-b8722bd3cef2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:19.278959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c08db848-07ca-4a92-9787-b8722bd3cef2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:19.279750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c08db848-07ca-4a92-9787-b8722bd3cef2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:19.280184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c08db848-07ca-4a92-9787-b8722bd3cef2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:19.355197 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c08db848-07ca-4a92-9787-b8722bd3cef2 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.089252 Nov 16 16:25:19.356156 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 598/1310] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:19 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:20.145073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-97bac312-92d4-4021-a88c-e2e271ca5284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:20.146322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-97bac312-92d4-4021-a88c-e2e271ca5284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:20.155104 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97bac312-92d4-4021-a88c-e2e271ca5284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:20.155662 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97bac312-92d4-4021-a88c-e2e271ca5284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:20.156765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97bac312-92d4-4021-a88c-e2e271ca5284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:20.157233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97bac312-92d4-4021-a88c-e2e271ca5284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:20.223534 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-97bac312-92d4-4021-a88c-e2e271ca5284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.083547 Nov 16 16:25:20.224576 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 713/1311] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:20 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:20.374138 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-57e92351-bd0c-4eee-9b65-26d2fcb7e5bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:20.376128 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-57e92351-bd0c-4eee-9b65-26d2fcb7e5bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:20.388176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-57e92351-bd0c-4eee-9b65-26d2fcb7e5bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:20.388923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-57e92351-bd0c-4eee-9b65-26d2fcb7e5bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:20.390226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-57e92351-bd0c-4eee-9b65-26d2fcb7e5bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:20.391127 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-57e92351-bd0c-4eee-9b65-26d2fcb7e5bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:20.457925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-57e92351-bd0c-4eee-9b65-26d2fcb7e5bf tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.090879 Nov 16 16:25:20.458902 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 599/1312] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:20 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:21.242447 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-375cd096-afcb-4f94-8dfe-0e2bc0e4715b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:21.244154 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-375cd096-afcb-4f94-8dfe-0e2bc0e4715b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:21.255998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-375cd096-afcb-4f94-8dfe-0e2bc0e4715b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:21.256788 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-375cd096-afcb-4f94-8dfe-0e2bc0e4715b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:21.258043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-375cd096-afcb-4f94-8dfe-0e2bc0e4715b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:21.258819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-375cd096-afcb-4f94-8dfe-0e2bc0e4715b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:21.330461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-375cd096-afcb-4f94-8dfe-0e2bc0e4715b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.094493 Nov 16 16:25:21.331238 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 714/1313] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:21 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:21.475379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c64bdb56-ae22-4ebe-831e-b6ff25f9d2fc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:21.477024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c64bdb56-ae22-4ebe-831e-b6ff25f9d2fc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:21.488950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c64bdb56-ae22-4ebe-831e-b6ff25f9d2fc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:21.489733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c64bdb56-ae22-4ebe-831e-b6ff25f9d2fc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:21.491036 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c64bdb56-ae22-4ebe-831e-b6ff25f9d2fc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:21.491743 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c64bdb56-ae22-4ebe-831e-b6ff25f9d2fc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:21.564972 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c64bdb56-ae22-4ebe-831e-b6ff25f9d2fc tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.096411 Nov 16 16:25:21.565794 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 600/1314] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:21 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:22.347651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-678b9252-a429-48ea-a12a-45a89c75bf2e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:22.348706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-678b9252-a429-48ea-a12a-45a89c75bf2e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:22.355927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-678b9252-a429-48ea-a12a-45a89c75bf2e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:22.356370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-678b9252-a429-48ea-a12a-45a89c75bf2e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:22.357200 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-678b9252-a429-48ea-a12a-45a89c75bf2e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:22.357622 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-678b9252-a429-48ea-a12a-45a89c75bf2e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:22.421114 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-678b9252-a429-48ea-a12a-45a89c75bf2e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.079142 Nov 16 16:25:22.421752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 715/1315] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:22 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:22.579790 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b0b89eb3-32ad-4a8b-977f-dcdefa50d256 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:22.580902 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b0b89eb3-32ad-4a8b-977f-dcdefa50d256 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:22.589702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0b89eb3-32ad-4a8b-977f-dcdefa50d256 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:22.590242 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0b89eb3-32ad-4a8b-977f-dcdefa50d256 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:22.591222 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0b89eb3-32ad-4a8b-977f-dcdefa50d256 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:22.591737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b0b89eb3-32ad-4a8b-977f-dcdefa50d256 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:22.664939 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b0b89eb3-32ad-4a8b-977f-dcdefa50d256 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.090219 Nov 16 16:25:22.665507 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 601/1316] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:22 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:23.436958 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-40124b36-775b-411c-aa4c-85c7d2d65072 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:23.438637 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-40124b36-775b-411c-aa4c-85c7d2d65072 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:23.450035 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-40124b36-775b-411c-aa4c-85c7d2d65072 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:23.450826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-40124b36-775b-411c-aa4c-85c7d2d65072 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:23.452099 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-40124b36-775b-411c-aa4c-85c7d2d65072 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:23.452823 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-40124b36-775b-411c-aa4c-85c7d2d65072 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:23.516026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-40124b36-775b-411c-aa4c-85c7d2d65072 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.085210 Nov 16 16:25:23.516985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 716/1317] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:23 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:23.681847 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4949ecd9-12f2-4032-bf62-2ca9a5456fe6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:23.683409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4949ecd9-12f2-4032-bf62-2ca9a5456fe6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:23.692654 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4949ecd9-12f2-4032-bf62-2ca9a5456fe6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:23.693122 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4949ecd9-12f2-4032-bf62-2ca9a5456fe6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:23.693901 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4949ecd9-12f2-4032-bf62-2ca9a5456fe6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:23.694335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4949ecd9-12f2-4032-bf62-2ca9a5456fe6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:23.756957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4949ecd9-12f2-4032-bf62-2ca9a5456fe6 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.082124 Nov 16 16:25:23.757576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 602/1318] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:23 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:24.532195 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-014e545f-4962-42b7-ba87-ebb1232412a8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:24.533228 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-014e545f-4962-42b7-ba87-ebb1232412a8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:24.540608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-014e545f-4962-42b7-ba87-ebb1232412a8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:24.541050 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-014e545f-4962-42b7-ba87-ebb1232412a8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:24.541826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-014e545f-4962-42b7-ba87-ebb1232412a8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:24.542259 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-014e545f-4962-42b7-ba87-ebb1232412a8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:24.604033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-014e545f-4962-42b7-ba87-ebb1232412a8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.078126 Nov 16 16:25:24.604630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 717/1319] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:24 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:24.771578 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6419dec3-8ada-40e7-82fc-a67fc4aba070 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:24.772668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6419dec3-8ada-40e7-82fc-a67fc4aba070 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:24.780089 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6419dec3-8ada-40e7-82fc-a67fc4aba070 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:24.780530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6419dec3-8ada-40e7-82fc-a67fc4aba070 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:24.781358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6419dec3-8ada-40e7-82fc-a67fc4aba070 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:24.781786 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6419dec3-8ada-40e7-82fc-a67fc4aba070 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:24.844996 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6419dec3-8ada-40e7-82fc-a67fc4aba070 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.077346 Nov 16 16:25:24.845715 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 603/1320] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:24 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:25.621303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9e0dd38a-516b-41cc-8582-a3d33ff8a10b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:25.623050 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9e0dd38a-516b-41cc-8582-a3d33ff8a10b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:25.635716 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e0dd38a-516b-41cc-8582-a3d33ff8a10b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:25.636485 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e0dd38a-516b-41cc-8582-a3d33ff8a10b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:25.637801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e0dd38a-516b-41cc-8582-a3d33ff8a10b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:25.638628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e0dd38a-516b-41cc-8582-a3d33ff8a10b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:25.701399 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9e0dd38a-516b-41cc-8582-a3d33ff8a10b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.087006 Nov 16 16:25:25.701996 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 718/1321] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:25 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:25.862211 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd0a0cda-1394-4e6c-9a13-b90befa5b2e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:25.863635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd0a0cda-1394-4e6c-9a13-b90befa5b2e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:25.873558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd0a0cda-1394-4e6c-9a13-b90befa5b2e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:25.874104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd0a0cda-1394-4e6c-9a13-b90befa5b2e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:25.875309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd0a0cda-1394-4e6c-9a13-b90befa5b2e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:25.875952 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd0a0cda-1394-4e6c-9a13-b90befa5b2e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:25.942952 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd0a0cda-1394-4e6c-9a13-b90befa5b2e9 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.086385 Nov 16 16:25:25.943756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 604/1322] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:25 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:26.718304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4f1e7da3-6847-4c8a-9b6f-bb7f12af9a9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:26.719941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4f1e7da3-6847-4c8a-9b6f-bb7f12af9a9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:26.727504 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f1e7da3-6847-4c8a-9b6f-bb7f12af9a9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:26.727947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f1e7da3-6847-4c8a-9b6f-bb7f12af9a9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:26.728740 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f1e7da3-6847-4c8a-9b6f-bb7f12af9a9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:26.729166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f1e7da3-6847-4c8a-9b6f-bb7f12af9a9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:26.793793 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4f1e7da3-6847-4c8a-9b6f-bb7f12af9a9c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 14 microversion: 2.20 time: 0.082361 Nov 16 16:25:26.794581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 719/1323] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:26 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:26.958284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-52be6662-766f-4029-b803-3ed9087f9e99 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:26.959382 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-52be6662-766f-4029-b803-3ed9087f9e99 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:26.967332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52be6662-766f-4029-b803-3ed9087f9e99 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:26.967805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52be6662-766f-4029-b803-3ed9087f9e99 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:26.968707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52be6662-766f-4029-b803-3ed9087f9e99 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:26.969098 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-52be6662-766f-4029-b803-3ed9087f9e99 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:27.040700 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-52be6662-766f-4029-b803-3ed9087f9e99 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.087398 Nov 16 16:25:27.041323 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 605/1324] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:26 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:27.805795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d7ff3e11-3b3c-427a-95b2-0fb9a428820c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:27.806828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d7ff3e11-3b3c-427a-95b2-0fb9a428820c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:27.814017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d7ff3e11-3b3c-427a-95b2-0fb9a428820c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:27.814493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d7ff3e11-3b3c-427a-95b2-0fb9a428820c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:27.815267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d7ff3e11-3b3c-427a-95b2-0fb9a428820c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:27.815693 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d7ff3e11-3b3c-427a-95b2-0fb9a428820c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:27.877738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d7ff3e11-3b3c-427a-95b2-0fb9a428820c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 6451 microversion: 2.20 time: 0.075540 Nov 16 16:25:27.878581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 720/1325] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:27 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 6451 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:25:28.057687 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1e329800-a3f9-49c6-af8f-0f5dcf6a3875 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:28.059183 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1e329800-a3f9-49c6-af8f-0f5dcf6a3875 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:28.070120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e329800-a3f9-49c6-af8f-0f5dcf6a3875 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:28.070941 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e329800-a3f9-49c6-af8f-0f5dcf6a3875 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:28.072229 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e329800-a3f9-49c6-af8f-0f5dcf6a3875 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:28.072948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1e329800-a3f9-49c6-af8f-0f5dcf6a3875 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:28.144274 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1e329800-a3f9-49c6-af8f-0f5dcf6a3875 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.093621 Nov 16 16:25:28.144908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 606/1326] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:28 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:28.893346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-be141c8c-8c2a-4e3b-b19d-6b1cbbb34110 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:28.894605 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-be141c8c-8c2a-4e3b-b19d-6b1cbbb34110 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:28.903461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be141c8c-8c2a-4e3b-b19d-6b1cbbb34110 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:28.904032 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be141c8c-8c2a-4e3b-b19d-6b1cbbb34110 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:28.904993 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be141c8c-8c2a-4e3b-b19d-6b1cbbb34110 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:28.905524 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-be141c8c-8c2a-4e3b-b19d-6b1cbbb34110 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:28.984386 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-be141c8c-8c2a-4e3b-b19d-6b1cbbb34110 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 15025 microversion: 2.20 time: 0.096581 Nov 16 16:25:28.985349 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 721/1327] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:28 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 15025 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:29.158994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10ba7bf3-c1ad-4a36-ab50-e12fe757c090 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:29.159986 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-10ba7bf3-c1ad-4a36-ab50-e12fe757c090 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:29.167376 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ba7bf3-c1ad-4a36-ab50-e12fe757c090 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:29.167866 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ba7bf3-c1ad-4a36-ab50-e12fe757c090 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:29.168631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ba7bf3-c1ad-4a36-ab50-e12fe757c090 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:29.169060 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10ba7bf3-c1ad-4a36-ab50-e12fe757c090 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:29.234737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-10ba7bf3-c1ad-4a36-ab50-e12fe757c090 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.080233 Nov 16 16:25:29.235444 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 607/1328] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:29 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:29.999267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5c7c8a5e-06db-4ecf-957a-1cd37e610ce9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:30.000429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5c7c8a5e-06db-4ecf-957a-1cd37e610ce9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:30.008952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c7c8a5e-06db-4ecf-957a-1cd37e610ce9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:30.009483 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c7c8a5e-06db-4ecf-957a-1cd37e610ce9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:30.010765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c7c8a5e-06db-4ecf-957a-1cd37e610ce9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:30.011279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5c7c8a5e-06db-4ecf-957a-1cd37e610ce9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:30.087796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5c7c8a5e-06db-4ecf-957a-1cd37e610ce9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 18498 microversion: 2.20 time: 0.092792 Nov 16 16:25:30.088815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 722/1329] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:29 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 18498 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:30.247181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-272b447a-83df-4e07-9dba-9c567d30f2d8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:30.248204 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-272b447a-83df-4e07-9dba-9c567d30f2d8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:30.255306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-272b447a-83df-4e07-9dba-9c567d30f2d8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:30.255768 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-272b447a-83df-4e07-9dba-9c567d30f2d8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:30.256534 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-272b447a-83df-4e07-9dba-9c567d30f2d8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:30.256957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-272b447a-83df-4e07-9dba-9c567d30f2d8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:30.320621 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-272b447a-83df-4e07-9dba-9c567d30f2d8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.077174 Nov 16 16:25:30.321816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 608/1330] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:30 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:31.107576 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c92ede97-99f5-4370-864b-d8162b13f1fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:31.109068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c92ede97-99f5-4370-864b-d8162b13f1fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:31.120740 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c92ede97-99f5-4370-864b-d8162b13f1fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:31.121481 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c92ede97-99f5-4370-864b-d8162b13f1fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:31.122816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c92ede97-99f5-4370-864b-d8162b13f1fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:31.123536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c92ede97-99f5-4370-864b-d8162b13f1fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:31.203250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c92ede97-99f5-4370-864b-d8162b13f1fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 19446 microversion: 2.20 time: 0.102453 Nov 16 16:25:31.204311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 723/1331] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:31 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 19446 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:31.339332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9451e9b2-6bf1-4995-b53b-aa18fb0767e7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:31.340937 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9451e9b2-6bf1-4995-b53b-aa18fb0767e7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:31.350153 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9451e9b2-6bf1-4995-b53b-aa18fb0767e7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:31.350644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9451e9b2-6bf1-4995-b53b-aa18fb0767e7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:31.351423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9451e9b2-6bf1-4995-b53b-aa18fb0767e7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:31.351862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9451e9b2-6bf1-4995-b53b-aa18fb0767e7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:31.424325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9451e9b2-6bf1-4995-b53b-aa18fb0767e7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.091449 Nov 16 16:25:31.425221 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 609/1332] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:31 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:32.222622 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4cfd3b96-4d2e-4755-b913-35805e3e4748 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:32.224316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4cfd3b96-4d2e-4755-b913-35805e3e4748 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:32.236248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cfd3b96-4d2e-4755-b913-35805e3e4748 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:32.237170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cfd3b96-4d2e-4755-b913-35805e3e4748 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:32.238073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cfd3b96-4d2e-4755-b913-35805e3e4748 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:32.238529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4cfd3b96-4d2e-4755-b913-35805e3e4748 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:32.322114 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4cfd3b96-4d2e-4755-b913-35805e3e4748 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 22494 microversion: 2.20 time: 0.106142 Nov 16 16:25:32.323129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 724/1333] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:32 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 22494 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:32.443465 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9eb6c19a-fc0a-4bbd-861e-f96e043d4937 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:32.445141 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9eb6c19a-fc0a-4bbd-861e-f96e043d4937 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:32.456636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb6c19a-fc0a-4bbd-861e-f96e043d4937 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:32.457082 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb6c19a-fc0a-4bbd-861e-f96e043d4937 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:32.457863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb6c19a-fc0a-4bbd-861e-f96e043d4937 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:32.458297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9eb6c19a-fc0a-4bbd-861e-f96e043d4937 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:32.527284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9eb6c19a-fc0a-4bbd-861e-f96e043d4937 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28666 microversion: 2.1 time: 0.090462 Nov 16 16:25:32.528188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 610/1334] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:32 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28666 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:33.341853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7dfe51fc-6313-4674-b084-ea29e2337bd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:33.343579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7dfe51fc-6313-4674-b084-ea29e2337bd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:33.352491 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7dfe51fc-6313-4674-b084-ea29e2337bd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:33.352951 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7dfe51fc-6313-4674-b084-ea29e2337bd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:33.353723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7dfe51fc-6313-4674-b084-ea29e2337bd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:33.354159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7dfe51fc-6313-4674-b084-ea29e2337bd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:33.430448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7dfe51fc-6313-4674-b084-ea29e2337bd8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 23803 microversion: 2.20 time: 0.094994 Nov 16 16:25:33.431389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 725/1335] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:33 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 23803 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:33.546934 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9abc50e1-5444-493f-92b8-07d8e372ffe7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:33.548541 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9abc50e1-5444-493f-92b8-07d8e372ffe7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:33.560644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9abc50e1-5444-493f-92b8-07d8e372ffe7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:33.561380 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9abc50e1-5444-493f-92b8-07d8e372ffe7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:33.562682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9abc50e1-5444-493f-92b8-07d8e372ffe7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:33.563351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9abc50e1-5444-493f-92b8-07d8e372ffe7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:33.653927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9abc50e1-5444-493f-92b8-07d8e372ffe7 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 28911 microversion: 2.1 time: 0.113475 Nov 16 16:25:33.654673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 611/1336] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:33 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 28911 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:34.445063 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-341541c3-340f-4598-ace8-8ddccad69e9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:34.446051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-341541c3-340f-4598-ace8-8ddccad69e9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:34.453685 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-341541c3-340f-4598-ace8-8ddccad69e9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:34.454134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-341541c3-340f-4598-ace8-8ddccad69e9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:34.454943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-341541c3-340f-4598-ace8-8ddccad69e9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:34.455368 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-341541c3-340f-4598-ace8-8ddccad69e9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:34.542155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-341541c3-340f-4598-ace8-8ddccad69e9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 25046 microversion: 2.20 time: 0.100744 Nov 16 16:25:34.543149 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 726/1337] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:34 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 25046 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:34.670750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-73f3b61f-a7b5-48e3-9494-fa7e61681887 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:34.671792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-73f3b61f-a7b5-48e3-9494-fa7e61681887 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:34.680468 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73f3b61f-a7b5-48e3-9494-fa7e61681887 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:34.680915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73f3b61f-a7b5-48e3-9494-fa7e61681887 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:34.681691 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73f3b61f-a7b5-48e3-9494-fa7e61681887 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:34.682131 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-73f3b61f-a7b5-48e3-9494-fa7e61681887 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:34.766899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-73f3b61f-a7b5-48e3-9494-fa7e61681887 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 30687 microversion: 2.1 time: 0.101177 Nov 16 16:25:34.766899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 612/1338] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:34 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 30687 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:35.560642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-6fa3a4e3-a6aa-49cc-9b61-9205bbf0ade9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:35.562306 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-6fa3a4e3-a6aa-49cc-9b61-9205bbf0ade9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:35.571336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6fa3a4e3-a6aa-49cc-9b61-9205bbf0ade9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:35.571785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6fa3a4e3-a6aa-49cc-9b61-9205bbf0ade9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:35.572567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6fa3a4e3-a6aa-49cc-9b61-9205bbf0ade9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:35.573028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-6fa3a4e3-a6aa-49cc-9b61-9205bbf0ade9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:35.646989 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-6fa3a4e3-a6aa-49cc-9b61-9205bbf0ade9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 26391 microversion: 2.20 time: 0.093150 Nov 16 16:25:35.647534 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 727/1339] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:35 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 26391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:35.874031 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-518c33a6-b1c5-4541-a902-9576c9810652 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:35.875792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-518c33a6-b1c5-4541-a902-9576c9810652 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:35.882789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-518c33a6-b1c5-4541-a902-9576c9810652 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:35.883236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-518c33a6-b1c5-4541-a902-9576c9810652 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:35.884112 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-518c33a6-b1c5-4541-a902-9576c9810652 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:35.884899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-518c33a6-b1c5-4541-a902-9576c9810652 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:35.965863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-518c33a6-b1c5-4541-a902-9576c9810652 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 32485 microversion: 2.1 time: 0.189034 Nov 16 16:25:35.966853 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 613/1340] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:35 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 32485 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:36.663753 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5d4deba0-9c6e-4bda-aaea-b9ec59d0d5a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:36.665613 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5d4deba0-9c6e-4bda-aaea-b9ec59d0d5a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:36.678279 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5d4deba0-9c6e-4bda-aaea-b9ec59d0d5a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:36.678764 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5d4deba0-9c6e-4bda-aaea-b9ec59d0d5a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:36.679621 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5d4deba0-9c6e-4bda-aaea-b9ec59d0d5a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:36.680040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5d4deba0-9c6e-4bda-aaea-b9ec59d0d5a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:36.765821 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5d4deba0-9c6e-4bda-aaea-b9ec59d0d5a5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 27496 microversion: 2.20 time: 0.109658 Nov 16 16:25:36.767385 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 728/1341] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:36 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 27496 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:36.985519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e84db29d-55f8-414c-b133-5b4c8e0c6c31 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:36.987047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e84db29d-55f8-414c-b133-5b4c8e0c6c31 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:36.998306 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e84db29d-55f8-414c-b133-5b4c8e0c6c31 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:36.999158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e84db29d-55f8-414c-b133-5b4c8e0c6c31 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:37.000441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e84db29d-55f8-414c-b133-5b4c8e0c6c31 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:37.001168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e84db29d-55f8-414c-b133-5b4c8e0c6c31 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:37.082282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e84db29d-55f8-414c-b133-5b4c8e0c6c31 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 33326 microversion: 2.1 time: 0.103431 Nov 16 16:25:37.083364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 614/1342] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:36 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 33326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:37.784612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ae53167f-a164-44fa-9dba-7207337cb025 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:37.786247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ae53167f-a164-44fa-9dba-7207337cb025 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:37.794425 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae53167f-a164-44fa-9dba-7207337cb025 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:37.795011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae53167f-a164-44fa-9dba-7207337cb025 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:37.795834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae53167f-a164-44fa-9dba-7207337cb025 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:37.796293 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae53167f-a164-44fa-9dba-7207337cb025 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:37.889608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ae53167f-a164-44fa-9dba-7207337cb025 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 27795 microversion: 2.20 time: 0.111783 Nov 16 16:25:37.890668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 729/1343] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:37 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 27795 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:38.103010 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b11102ab-9183-4f75-96fb-96eb92385a56 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:38.104518 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b11102ab-9183-4f75-96fb-96eb92385a56 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:38.115825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b11102ab-9183-4f75-96fb-96eb92385a56 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:38.116265 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b11102ab-9183-4f75-96fb-96eb92385a56 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:38.117081 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b11102ab-9183-4f75-96fb-96eb92385a56 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:38.117506 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b11102ab-9183-4f75-96fb-96eb92385a56 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:38.196863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b11102ab-9183-4f75-96fb-96eb92385a56 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 34353 microversion: 2.1 time: 0.101477 Nov 16 16:25:38.197572 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 615/1344] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:38 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 34353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:38.907343 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-eeb75e76-bfae-4385-ba48-1769a29165f9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:38.909011 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-eeb75e76-bfae-4385-ba48-1769a29165f9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:38.920673 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eeb75e76-bfae-4385-ba48-1769a29165f9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:38.921463 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eeb75e76-bfae-4385-ba48-1769a29165f9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:38.922797 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eeb75e76-bfae-4385-ba48-1769a29165f9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:38.923515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eeb75e76-bfae-4385-ba48-1769a29165f9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:39.018043 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-eeb75e76-bfae-4385-ba48-1769a29165f9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.117408 Nov 16 16:25:39.019143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 730/1345] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:38 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:39.213046 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0726423f-cba6-450e-af96-7ab6c94eba49 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:39.214067 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0726423f-cba6-450e-af96-7ab6c94eba49 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:39.221443 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0726423f-cba6-450e-af96-7ab6c94eba49 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:39.221921 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0726423f-cba6-450e-af96-7ab6c94eba49 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:39.222824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0726423f-cba6-450e-af96-7ab6c94eba49 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:39.223709 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0726423f-cba6-450e-af96-7ab6c94eba49 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:39.303481 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0726423f-cba6-450e-af96-7ab6c94eba49 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 35574 microversion: 2.1 time: 0.094613 Nov 16 16:25:39.304049 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 616/1346] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:39 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 35574 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 16 16:25:40.034497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a32ea9d9-70fd-4b19-a2a3-fafcf5fb95b9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:40.035968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a32ea9d9-70fd-4b19-a2a3-fafcf5fb95b9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:40.043967 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a32ea9d9-70fd-4b19-a2a3-fafcf5fb95b9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:40.044416 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a32ea9d9-70fd-4b19-a2a3-fafcf5fb95b9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:40.045202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a32ea9d9-70fd-4b19-a2a3-fafcf5fb95b9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:40.045637 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a32ea9d9-70fd-4b19-a2a3-fafcf5fb95b9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:40.111308 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a32ea9d9-70fd-4b19-a2a3-fafcf5fb95b9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.083081 Nov 16 16:25:40.112215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 731/1347] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:40 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:40.321637 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3205b3b3-4ad2-48d0-a964-f90f60f39a0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:40.323208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3205b3b3-4ad2-48d0-a964-f90f60f39a0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:40.334875 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3205b3b3-4ad2-48d0-a964-f90f60f39a0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:40.335439 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3205b3b3-4ad2-48d0-a964-f90f60f39a0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:40.336226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3205b3b3-4ad2-48d0-a964-f90f60f39a0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:40.336669 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3205b3b3-4ad2-48d0-a964-f90f60f39a0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:40.421724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3205b3b3-4ad2-48d0-a964-f90f60f39a0b tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 37076 microversion: 2.1 time: 0.107422 Nov 16 16:25:40.422528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 617/1348] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:40 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 37076 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:41.124212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-504e85ec-8339-4bb5-9d8d-94c8425f4f4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:41.125105 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-504e85ec-8339-4bb5-9d8d-94c8425f4f4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:41.132466 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-504e85ec-8339-4bb5-9d8d-94c8425f4f4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:41.132931 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-504e85ec-8339-4bb5-9d8d-94c8425f4f4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:41.133741 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-504e85ec-8339-4bb5-9d8d-94c8425f4f4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:41.134161 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-504e85ec-8339-4bb5-9d8d-94c8425f4f4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:41.217163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-504e85ec-8339-4bb5-9d8d-94c8425f4f4a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.096492 Nov 16 16:25:41.218135 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 732/1349] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:41 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:41.439724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6f18a8bc-1fc9-43aa-80cc-430a879b9f76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:41.441359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6f18a8bc-1fc9-43aa-80cc-430a879b9f76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:41.451597 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f18a8bc-1fc9-43aa-80cc-430a879b9f76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:41.452200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f18a8bc-1fc9-43aa-80cc-430a879b9f76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:41.453351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f18a8bc-1fc9-43aa-80cc-430a879b9f76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:41.453933 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6f18a8bc-1fc9-43aa-80cc-430a879b9f76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:41.532091 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6f18a8bc-1fc9-43aa-80cc-430a879b9f76 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 38196 microversion: 2.1 time: 0.099495 Nov 16 16:25:41.532741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 618/1350] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:41 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 38196 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:42.234528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5715bc1a-355d-48db-a691-35a68462f764 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:42.235788 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5715bc1a-355d-48db-a691-35a68462f764 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:42.245304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5715bc1a-355d-48db-a691-35a68462f764 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:42.245866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5715bc1a-355d-48db-a691-35a68462f764 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:42.246875 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5715bc1a-355d-48db-a691-35a68462f764 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:42.247812 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5715bc1a-355d-48db-a691-35a68462f764 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:42.318597 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5715bc1a-355d-48db-a691-35a68462f764 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.089125 Nov 16 16:25:42.319307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 733/1351] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:42 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:42.549489 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d3c3d3d1-290c-41dd-80a5-36732ace75de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:42.551149 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d3c3d3d1-290c-41dd-80a5-36732ace75de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:42.559735 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3c3d3d1-290c-41dd-80a5-36732ace75de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:42.560180 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3c3d3d1-290c-41dd-80a5-36732ace75de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:42.560943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3c3d3d1-290c-41dd-80a5-36732ace75de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:42.561365 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d3c3d3d1-290c-41dd-80a5-36732ace75de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:42.629592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d3c3d3d1-290c-41dd-80a5-36732ace75de tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 38196 microversion: 2.1 time: 0.086911 Nov 16 16:25:42.630275 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 619/1352] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:42 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 38196 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:43.335559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f8cc8135-1792-4230-8057-556dd743c0bb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:43.336593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f8cc8135-1792-4230-8057-556dd743c0bb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:43.344176 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8cc8135-1792-4230-8057-556dd743c0bb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:43.344623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8cc8135-1792-4230-8057-556dd743c0bb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:43.345404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8cc8135-1792-4230-8057-556dd743c0bb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:43.345837 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f8cc8135-1792-4230-8057-556dd743c0bb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:43.411949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f8cc8135-1792-4230-8057-556dd743c0bb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.082911 Nov 16 16:25:43.412795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 734/1353] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:43 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:43.646176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-93ed1f15-94f9-4322-a8b7-f7c03685fd23 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:43.647686 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-93ed1f15-94f9-4322-a8b7-f7c03685fd23 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:43.659610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93ed1f15-94f9-4322-a8b7-f7c03685fd23 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:43.660356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93ed1f15-94f9-4322-a8b7-f7c03685fd23 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:43.661633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93ed1f15-94f9-4322-a8b7-f7c03685fd23 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:43.662334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-93ed1f15-94f9-4322-a8b7-f7c03685fd23 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:43.725542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-93ed1f15-94f9-4322-a8b7-f7c03685fd23 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 38196 microversion: 2.1 time: 0.086210 Nov 16 16:25:43.726154 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 620/1354] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:43 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 38196 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:44.428310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a6ef8358-2c25-4903-90c9-7a9f894a4f9e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:44.429669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a6ef8358-2c25-4903-90c9-7a9f894a4f9e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:44.439699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6ef8358-2c25-4903-90c9-7a9f894a4f9e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:44.440372 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6ef8358-2c25-4903-90c9-7a9f894a4f9e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:44.441536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6ef8358-2c25-4903-90c9-7a9f894a4f9e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:44.442190 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6ef8358-2c25-4903-90c9-7a9f894a4f9e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:44.504310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a6ef8358-2c25-4903-90c9-7a9f894a4f9e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.082269 Nov 16 16:25:44.504976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 735/1355] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:44 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:44.739000 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c2563cd3-1ef6-46b2-ba17-3755a05e1613 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:44.739965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c2563cd3-1ef6-46b2-ba17-3755a05e1613 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:44.747576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2563cd3-1ef6-46b2-ba17-3755a05e1613 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:44.748032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2563cd3-1ef6-46b2-ba17-3755a05e1613 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:44.748819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2563cd3-1ef6-46b2-ba17-3755a05e1613 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:44.749255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c2563cd3-1ef6-46b2-ba17-3755a05e1613 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:44.825851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c2563cd3-1ef6-46b2-ba17-3755a05e1613 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 38198 microversion: 2.1 time: 0.091047 Nov 16 16:25:44.826525 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 621/1356] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:44 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 38198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:45.521500 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3e77c4bb-10c8-4f5a-9342-a5ffa197f6ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:45.523202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3e77c4bb-10c8-4f5a-9342-a5ffa197f6ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:45.531071 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e77c4bb-10c8-4f5a-9342-a5ffa197f6ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:45.531515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e77c4bb-10c8-4f5a-9342-a5ffa197f6ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:45.532331 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e77c4bb-10c8-4f5a-9342-a5ffa197f6ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:45.532770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3e77c4bb-10c8-4f5a-9342-a5ffa197f6ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:45.594937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3e77c4bb-10c8-4f5a-9342-a5ffa197f6ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.080258 Nov 16 16:25:45.595591 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 736/1357] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:45 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:45.838960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b6eadcdb-2acc-48fc-97e9-ad4e097a8c64 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:45.839953 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b6eadcdb-2acc-48fc-97e9-ad4e097a8c64 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:45.847585 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6eadcdb-2acc-48fc-97e9-ad4e097a8c64 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:45.848038 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6eadcdb-2acc-48fc-97e9-ad4e097a8c64 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:45.848851 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6eadcdb-2acc-48fc-97e9-ad4e097a8c64 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:45.849279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b6eadcdb-2acc-48fc-97e9-ad4e097a8c64 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:45.931650 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b6eadcdb-2acc-48fc-97e9-ad4e097a8c64 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action" status: 200 len: 38327 microversion: 2.1 time: 0.096604 Nov 16 16:25:45.932416 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 622/1358] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:25:45 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/action => generated 38327 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:25:45.945233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-99054f08-53ba-4898-a3ef-8ef34dfe2a86 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:45.945948 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-99054f08-53ba-4898-a3ef-8ef34dfe2a86 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:45.953448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99054f08-53ba-4898-a3ef-8ef34dfe2a86 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:45.953889 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99054f08-53ba-4898-a3ef-8ef34dfe2a86 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:45.954699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99054f08-53ba-4898-a3ef-8ef34dfe2a86 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:45.956662 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-99054f08-53ba-4898-a3ef-8ef34dfe2a86 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:45.983514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-99054f08-53ba-4898-a3ef-8ef34dfe2a86 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/ips" status: 200 len: 146 microversion: 2.1 time: 0.043322 Nov 16 16:25:45.984079 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 737/1359] 10.222.0.61 () {58 vars in 1247 bytes} [Tue Nov 16 16:25:45 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:46.612211 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dd3e58a7-982e-4c2d-8faa-270397dc6f7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:46.613829 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dd3e58a7-982e-4c2d-8faa-270397dc6f7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:46.622855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd3e58a7-982e-4c2d-8faa-270397dc6f7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:46.623299 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd3e58a7-982e-4c2d-8faa-270397dc6f7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:46.624063 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd3e58a7-982e-4c2d-8faa-270397dc6f7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:46.624485 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dd3e58a7-982e-4c2d-8faa-270397dc6f7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:46.692665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dd3e58a7-982e-4c2d-8faa-270397dc6f7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.087197 Nov 16 16:25:46.693252 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 623/1360] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:46 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:47.314016 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c0108d2c-c8bb-4582-9e8a-ec722f93ceee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e6f7c48-11a5-48e0-b066-029569efee82"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:47.315307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c0108d2c-c8bb-4582-9e8a-ec722f93ceee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:47.325697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0108d2c-c8bb-4582-9e8a-ec722f93ceee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:47.326304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0108d2c-c8bb-4582-9e8a-ec722f93ceee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:47.327517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0108d2c-c8bb-4582-9e8a-ec722f93ceee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:47.328120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c0108d2c-c8bb-4582-9e8a-ec722f93ceee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:47.675391 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c0108d2c-c8bb-4582-9e8a-ec722f93ceee tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367301 Nov 16 16:25:47.675999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 738/1361] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:25:47 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:47.706489 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-77a0895f-5f8a-4ca3-8aa0-5b5daca93384 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:47.707573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-77a0895f-5f8a-4ca3-8aa0-5b5daca93384 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:47.715309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77a0895f-5f8a-4ca3-8aa0-5b5daca93384 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:47.715751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77a0895f-5f8a-4ca3-8aa0-5b5daca93384 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:47.716719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77a0895f-5f8a-4ca3-8aa0-5b5daca93384 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:47.716995 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-77a0895f-5f8a-4ca3-8aa0-5b5daca93384 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:47.792120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-77a0895f-5f8a-4ca3-8aa0-5b5daca93384 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.089866 Nov 16 16:25:47.792815 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 624/1362] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:47 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:48.807755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1b352832-d157-4a51-9410-9c34ab3f6c23 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:48.809111 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1b352832-d157-4a51-9410-9c34ab3f6c23 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:48.816281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b352832-d157-4a51-9410-9c34ab3f6c23 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:48.816771 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b352832-d157-4a51-9410-9c34ab3f6c23 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:48.817557 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b352832-d157-4a51-9410-9c34ab3f6c23 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:48.817991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b352832-d157-4a51-9410-9c34ab3f6c23 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:48.885896 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1b352832-d157-4a51-9410-9c34ab3f6c23 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.084360 Nov 16 16:25:48.886736 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 739/1363] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:48 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:49.904255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6baca72d-9099-44d9-a574-5923eea0cb3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:49.905909 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6baca72d-9099-44d9-a574-5923eea0cb3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:49.918147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6baca72d-9099-44d9-a574-5923eea0cb3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:49.918680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6baca72d-9099-44d9-a574-5923eea0cb3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:49.919440 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6baca72d-9099-44d9-a574-5923eea0cb3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:49.919873 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6baca72d-9099-44d9-a574-5923eea0cb3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:49.996592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6baca72d-9099-44d9-a574-5923eea0cb3e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.098887 Nov 16 16:25:49.997321 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 625/1364] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:49 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:51.014047 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-86a5314f-824b-4323-8aa4-83ace74138ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:51.015296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-86a5314f-824b-4323-8aa4-83ace74138ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:51.022843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86a5314f-824b-4323-8aa4-83ace74138ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:51.023295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86a5314f-824b-4323-8aa4-83ace74138ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:51.024074 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86a5314f-824b-4323-8aa4-83ace74138ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:51.024574 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-86a5314f-824b-4323-8aa4-83ace74138ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:51.099136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-86a5314f-824b-4323-8aa4-83ace74138ed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28165 microversion: 2.20 time: 0.092364 Nov 16 16:25:51.099759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 740/1365] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:51 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28165 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:52.114202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-944b9c49-0ec8-43ac-a2c2-ff36953f4ac6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:52.115215 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-944b9c49-0ec8-43ac-a2c2-ff36953f4ac6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:52.122364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-944b9c49-0ec8-43ac-a2c2-ff36953f4ac6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:52.122860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-944b9c49-0ec8-43ac-a2c2-ff36953f4ac6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:52.123716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-944b9c49-0ec8-43ac-a2c2-ff36953f4ac6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:52.124110 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-944b9c49-0ec8-43ac-a2c2-ff36953f4ac6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:52.202966 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-944b9c49-0ec8-43ac-a2c2-ff36953f4ac6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28456 microversion: 2.20 time: 0.092370 Nov 16 16:25:52.203787 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 626/1366] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:52 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28456 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:53.217182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0f13d172-d265-4246-b070-91b647dab571 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:53.219039 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0f13d172-d265-4246-b070-91b647dab571 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:53.226207 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f13d172-d265-4246-b070-91b647dab571 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:53.226680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f13d172-d265-4246-b070-91b647dab571 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:53.227468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f13d172-d265-4246-b070-91b647dab571 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:53.227893 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0f13d172-d265-4246-b070-91b647dab571 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:53.298526 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0f13d172-d265-4246-b070-91b647dab571 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28456 microversion: 2.20 time: 0.085268 Nov 16 16:25:53.299172 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 741/1367] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:53 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28456 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:54.018896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:54.019558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:54.029362 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:54.030340 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:54.031590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:54.032225 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:54.061299 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:25:54.090665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-00d2beff-f6bb-47e8-a152-4c62e8a544d5 req-e3e537f4-6b9b-4565-88b3-67a13141bfac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78eb3995-5e51-438c-932d-e5740e28c38e", "tag": "e73fa700-ec5c-41fb-b99b-cd813ff621b5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:54.092287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:25:54.092287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:25:54.103153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-00d2beff-f6bb-47e8-a152-4c62e8a544d5 req-e3e537f4-6b9b-4565-88b3-67a13141bfac service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:54.103662 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-00d2beff-f6bb-47e8-a152-4c62e8a544d5 req-e3e537f4-6b9b-4565-88b3-67a13141bfac service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:54.115214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-00d2beff-f6bb-47e8-a152-4c62e8a544d5 req-e3e537f4-6b9b-4565-88b3-67a13141bfac service nova] Creating event network-changed:e73fa700-ec5c-41fb-b99b-cd813ff621b5 for instance 78eb3995-5e51-438c-932d-e5740e28c38e on hv-cinder-78776 Nov 16 16:25:54.120870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-00d2beff-f6bb-47e8-a152-4c62e8a544d5 req-e3e537f4-6b9b-4565-88b3-67a13141bfac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103512 Nov 16 16:25:54.121863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 742/1368] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:25:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:54.148420 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e845ac22-922d-4372-a8d6-38d486bcbe98 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "DELETE /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 204 len: 0 microversion: 2.1 time: 0.131851 Nov 16 16:25:54.151407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 627/1369] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:25:54 2021] DELETE /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:25:54.159957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:54.160952 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:54.167999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:54.168445 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:54.169235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:54.169703 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:54.310928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-265ddda4-81c1-4746-82af-4c2dafe4b8cb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:54.314273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-265ddda4-81c1-4746-82af-4c2dafe4b8cb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:54.324188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-265ddda4-81c1-4746-82af-4c2dafe4b8cb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:54.324940 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-265ddda4-81c1-4746-82af-4c2dafe4b8cb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:54.326032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-265ddda4-81c1-4746-82af-4c2dafe4b8cb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:54.326643 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-265ddda4-81c1-4746-82af-4c2dafe4b8cb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:54.406350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:54.410698 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-265ddda4-81c1-4746-82af-4c2dafe4b8cb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.103815 Nov 16 16:25:54.415375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 628/1370] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:54 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:25:54.424687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-044f000b-0a3c-41f3-ac88-121f4d1ac274 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1569 microversion: 2.1 time: 0.268732 Nov 16 16:25:54.425654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 743/1371] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:25:54 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:25:55.199169 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e5703c3d-21ae-4b19-a2fd-9313cdedb1c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:55.200170 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e5703c3d-21ae-4b19-a2fd-9313cdedb1c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:55.207383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5703c3d-21ae-4b19-a2fd-9313cdedb1c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.207756 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5703c3d-21ae-4b19-a2fd-9313cdedb1c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.208659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5703c3d-21ae-4b19-a2fd-9313cdedb1c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.209096 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e5703c3d-21ae-4b19-a2fd-9313cdedb1c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.239990 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e5703c3d-21ae-4b19-a2fd-9313cdedb1c4 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Nov 16 16:25:55.240558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 629/1372] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:25:55 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:55.250916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-061b3617-01fe-40b7-a99c-f5d0bc878abe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:55.251402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-061b3617-01fe-40b7-a99c-f5d0bc878abe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:55.258288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-061b3617-01fe-40b7-a99c-f5d0bc878abe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.259227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-061b3617-01fe-40b7-a99c-f5d0bc878abe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.260102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-061b3617-01fe-40b7-a99c-f5d0bc878abe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.260590 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-061b3617-01fe-40b7-a99c-f5d0bc878abe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.289655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-061b3617-01fe-40b7-a99c-f5d0bc878abe tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/3e6f7c48-11a5-48e0-b066-029569efee82" status: 200 len: 194 microversion: 2.1 time: 0.042637 Nov 16 16:25:55.290239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 744/1373] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Nov 16 16:25:55 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/3e6f7c48-11a5-48e0-b066-029569efee82 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:25:55.424432 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-10b397a8-a83e-4c8c-9124-314f3a8d4fc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:55.425591 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-10b397a8-a83e-4c8c-9124-314f3a8d4fc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:55.432244 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10b397a8-a83e-4c8c-9124-314f3a8d4fc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.432695 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10b397a8-a83e-4c8c-9124-314f3a8d4fc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.433480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10b397a8-a83e-4c8c-9124-314f3a8d4fc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.434161 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-10b397a8-a83e-4c8c-9124-314f3a8d4fc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.444611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:55.445503 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:55.452058 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.452977 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.453956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:55.454602 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:55.546959 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-10b397a8-a83e-4c8c-9124-314f3a8d4fc3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.127045 Nov 16 16:25:55.547799 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 630/1374] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:55 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:55.607444 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:55.615009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2f9ebf7a-4b70-4137-a98b-9975a80173ad tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1451 microversion: 2.1 time: 0.174408 Nov 16 16:25:55.615572 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 745/1375] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:25:55 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:56.634343 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-32da711d-ba24-488b-b345-ae86a89993f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:56.636814 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-32da711d-ba24-488b-b345-ae86a89993f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:56.645273 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-0d8daad8-bacc-41d7-b11c-e701470a6aef req-069090e1-08c0-47bd-92b4-616234de4aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78eb3995-5e51-438c-932d-e5740e28c38e", "name": "network-vif-deleted", "tag": "e73fa700-ec5c-41fb-b99b-cd813ff621b5"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:56.647448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:25:56.647448 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:25:56.648099 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32da711d-ba24-488b-b345-ae86a89993f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:56.648551 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32da711d-ba24-488b-b345-ae86a89993f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:56.649341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32da711d-ba24-488b-b345-ae86a89993f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:56.649771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-32da711d-ba24-488b-b345-ae86a89993f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:56.660625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-0d8daad8-bacc-41d7-b11c-e701470a6aef req-069090e1-08c0-47bd-92b4-616234de4aa4 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:56.661486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-0d8daad8-bacc-41d7-b11c-e701470a6aef req-069090e1-08c0-47bd-92b4-616234de4aa4 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:56.675862 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-0d8daad8-bacc-41d7-b11c-e701470a6aef req-069090e1-08c0-47bd-92b4-616234de4aa4 service nova] Creating event network-vif-deleted:e73fa700-ec5c-41fb-b99b-cd813ff621b5 for instance 78eb3995-5e51-438c-932d-e5740e28c38e on hv-cinder-78776 Nov 16 16:25:56.680593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-0d8daad8-bacc-41d7-b11c-e701470a6aef req-069090e1-08c0-47bd-92b4-616234de4aa4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049709 Nov 16 16:25:56.681175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 746/1376] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:25:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:56.689040 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:56.689979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:56.696390 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:56.696832 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:56.697651 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:56.698080 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:56.730284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-32da711d-ba24-488b-b345-ae86a89993f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.174351 Nov 16 16:25:56.730988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 631/1377] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:56 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:56.739896 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-22d35e97-1b0c-41e4-b840-90aa74aaae92 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ada95caf-4875-4524-93f0-f33adf196c2f"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:56.741051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-22d35e97-1b0c-41e4-b840-90aa74aaae92 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:56.748890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22d35e97-1b0c-41e4-b840-90aa74aaae92 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:56.749499 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22d35e97-1b0c-41e4-b840-90aa74aaae92 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:56.750454 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22d35e97-1b0c-41e4-b840-90aa74aaae92 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:56.750886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-22d35e97-1b0c-41e4-b840-90aa74aaae92 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:56.764427 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ecde32d12664c48a8cff7bf839eb505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9e25e747f14010be9908f8ccb0712f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:25:56.772218 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3607ef84-4027-4fbb-8dcf-6bf64f499542 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 200 len: 1219 microversion: 2.1 time: 0.087046 Nov 16 16:25:56.772801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 747/1378] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:25:56 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:25:57.082112 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-22d35e97-1b0c-41e4-b840-90aa74aaae92 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345953 Nov 16 16:25:57.083102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 632/1379] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:25:56 2021] POST /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:25:57.743119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-87cf7c05-0b05-45e7-98d1-9d7ea263d2dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:57.743971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-87cf7c05-0b05-45e7-98d1-9d7ea263d2dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:57.751496 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87cf7c05-0b05-45e7-98d1-9d7ea263d2dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:57.751982 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87cf7c05-0b05-45e7-98d1-9d7ea263d2dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:57.752796 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87cf7c05-0b05-45e7-98d1-9d7ea263d2dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:57.753243 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-87cf7c05-0b05-45e7-98d1-9d7ea263d2dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:57.792364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:57.793169 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] [instance: 78eb3995-5e51-438c-932d-e5740e28c38e] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:57.801526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:57.801912 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:57.802716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:57.803147 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:57.817350 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-87cf7c05-0b05-45e7-98d1-9d7ea263d2dd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.078059 Nov 16 16:25:57.817899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] HTTP exception thrown: Instance 78eb3995-5e51-438c-932d-e5740e28c38e could not be found. Nov 16 16:25:57.821468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 748/1380] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:57 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:57.821605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Returning 404 to user: Instance 78eb3995-5e51-438c-932d-e5740e28c38e could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:25:57.821605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fdac7139-336e-4981-b6b6-fb85404e733e tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e" status: 404 len: 111 microversion: 2.1 time: 0.033449 Nov 16 16:25:57.821605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 633/1381] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:25:57 2021] GET /compute/v2.1/servers/78eb3995-5e51-438c-932d-e5740e28c38e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:25:57.991077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ee978ee0-3c5a-44fb-a630-cb2eff822ce9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] Calling method '.version_select at 0x7f3ec3505f70>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:25:58.020310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ee978ee0-3c5a-44fb-a630-cb2eff822ce9 tempest-TestShelveInstance-1928024059 tempest-TestShelveInstance-1928024059-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-157657213" status: 202 len: 0 microversion: 2.1 time: 0.033245 Nov 16 16:25:58.020975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 749/1382] 10.222.0.61 () {58 vars in 1250 bytes} [Tue Nov 16 16:25:57 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-157657213 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:25:58.829436 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4074cb86-ead5-4a3d-9ef8-900e22c633f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:58.830517 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4074cb86-ead5-4a3d-9ef8-900e22c633f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:58.837179 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4074cb86-ead5-4a3d-9ef8-900e22c633f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:58.837633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4074cb86-ead5-4a3d-9ef8-900e22c633f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:58.838448 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4074cb86-ead5-4a3d-9ef8-900e22c633f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:58.838907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4074cb86-ead5-4a3d-9ef8-900e22c633f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:58.905450 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4074cb86-ead5-4a3d-9ef8-900e22c633f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.079606 Nov 16 16:25:58.906114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 634/1383] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:58 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:25:59.917402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7b078deb-972e-4d2d-8098-94661b2e13e9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:25:59.919222 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7b078deb-972e-4d2d-8098-94661b2e13e9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:25:59.928320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7b078deb-972e-4d2d-8098-94661b2e13e9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:59.928752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7b078deb-972e-4d2d-8098-94661b2e13e9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:59.929553 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7b078deb-972e-4d2d-8098-94661b2e13e9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:25:59.929981 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7b078deb-972e-4d2d-8098-94661b2e13e9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:25:59.998196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7b078deb-972e-4d2d-8098-94661b2e13e9 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.084448 Nov 16 16:25:59.999402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 750/1384] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:25:59 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:01.012124 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ed67b8fa-aaf3-4123-83b8-ffab5b9bdaae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:01.013792 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ed67b8fa-aaf3-4123-83b8-ffab5b9bdaae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:01.021129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed67b8fa-aaf3-4123-83b8-ffab5b9bdaae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:01.021573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed67b8fa-aaf3-4123-83b8-ffab5b9bdaae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:01.022344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed67b8fa-aaf3-4123-83b8-ffab5b9bdaae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:01.022955 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ed67b8fa-aaf3-4123-83b8-ffab5b9bdaae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:01.087444 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ed67b8fa-aaf3-4123-83b8-ffab5b9bdaae tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.079650 Nov 16 16:26:01.088336 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 635/1385] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:01 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:02.100316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3d8cdec5-7841-4c5c-8096-cf91ced79003 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:02.101370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3d8cdec5-7841-4c5c-8096-cf91ced79003 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:02.109126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3d8cdec5-7841-4c5c-8096-cf91ced79003 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:02.109573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3d8cdec5-7841-4c5c-8096-cf91ced79003 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:02.110361 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3d8cdec5-7841-4c5c-8096-cf91ced79003 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:02.110826 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3d8cdec5-7841-4c5c-8096-cf91ced79003 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:02.173390 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3d8cdec5-7841-4c5c-8096-cf91ced79003 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.076990 Nov 16 16:26:02.174037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 751/1386] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:02 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:03.186635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-86b4a9ec-4bf6-4a92-b1f9-11e69ec15a90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:03.188505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-86b4a9ec-4bf6-4a92-b1f9-11e69ec15a90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:03.195783 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86b4a9ec-4bf6-4a92-b1f9-11e69ec15a90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:03.196236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86b4a9ec-4bf6-4a92-b1f9-11e69ec15a90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:03.197015 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86b4a9ec-4bf6-4a92-b1f9-11e69ec15a90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:03.197447 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-86b4a9ec-4bf6-4a92-b1f9-11e69ec15a90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:03.262314 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-86b4a9ec-4bf6-4a92-b1f9-11e69ec15a90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.080353 Nov 16 16:26:03.263726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 636/1387] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:03 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:26:04.275310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5f07b8be-e2d0-4e40-8b62-08167869e72a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:04.277125 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5f07b8be-e2d0-4e40-8b62-08167869e72a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:04.284495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f07b8be-e2d0-4e40-8b62-08167869e72a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.284946 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f07b8be-e2d0-4e40-8b62-08167869e72a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:04.285974 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f07b8be-e2d0-4e40-8b62-08167869e72a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.286410 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5f07b8be-e2d0-4e40-8b62-08167869e72a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:04.377748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5f07b8be-e2d0-4e40-8b62-08167869e72a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.106657 Nov 16 16:26:04.378929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 752/1388] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:04 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:04.647858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d6341cfc-f161-4880-983e-fbbf7e28d307 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:04.649955 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d6341cfc-f161-4880-983e-fbbf7e28d307 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:04.657076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6341cfc-f161-4880-983e-fbbf7e28d307 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.658286 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6341cfc-f161-4880-983e-fbbf7e28d307 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:04.659586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6341cfc-f161-4880-983e-fbbf7e28d307 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.660008 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d6341cfc-f161-4880-983e-fbbf7e28d307 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:04.696818 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d6341cfc-f161-4880-983e-fbbf7e28d307 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053857 Nov 16 16:26:04.697753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 637/1389] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:26:04 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:26:04.914367 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a782c40c-3bcc-40c9-b208-0e66cc8b51a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:04.915010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a782c40c-3bcc-40c9-b208-0e66cc8b51a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:04.922480 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a782c40c-3bcc-40c9-b208-0e66cc8b51a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.922965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a782c40c-3bcc-40c9-b208-0e66cc8b51a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:04.923947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a782c40c-3bcc-40c9-b208-0e66cc8b51a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.924560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a782c40c-3bcc-40c9-b208-0e66cc8b51a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:04.957126 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a782c40c-3bcc-40c9-b208-0e66cc8b51a5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/3e6f7c48-11a5-48e0-b066-029569efee82" status: 200 len: 194 microversion: 2.1 time: 0.046977 Nov 16 16:26:04.957738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 753/1390] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Nov 16 16:26:04 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/3e6f7c48-11a5-48e0-b066-029569efee82 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:26:04.967906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:04.968401 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:04.974710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.975146 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:04.975915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:04.976338 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:05.064583 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lazy-loading 'services' on Instance uuid 807406d2-6025-4a97-a3ce-a61720020aef {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:26:05.138814 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cf5eb0be-ddcc-46b7-8513-ac2fe31bb10c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/3e6f7c48-11a5-48e0-b066-029569efee82" status: 202 len: 0 microversion: 2.1 time: 0.174973 Nov 16 16:26:05.139965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 638/1391] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:26:04 2021] DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/3e6f7c48-11a5-48e0-b066-029569efee82 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:26:05.392863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-833daa1d-7e9d-4cd6-b9bf-ac95a13bfab6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:05.393779 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-833daa1d-7e9d-4cd6-b9bf-ac95a13bfab6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:05.400088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-833daa1d-7e9d-4cd6-b9bf-ac95a13bfab6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:05.400544 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-833daa1d-7e9d-4cd6-b9bf-ac95a13bfab6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:05.401321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-833daa1d-7e9d-4cd6-b9bf-ac95a13bfab6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:05.401749 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-833daa1d-7e9d-4cd6-b9bf-ac95a13bfab6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:05.471119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-833daa1d-7e9d-4cd6-b9bf-ac95a13bfab6 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.082597 Nov 16 16:26:05.477102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 754/1392] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:05 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:06.256822 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-1bef0c7d-c9e2-47b8-b8a6-411e1c843202 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:06.257385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-1bef0c7d-c9e2-47b8-b8a6-411e1c843202 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:06.264352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bef0c7d-c9e2-47b8-b8a6-411e1c843202 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:06.264791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bef0c7d-c9e2-47b8-b8a6-411e1c843202 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:06.265588 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bef0c7d-c9e2-47b8-b8a6-411e1c843202 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:06.266016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-1bef0c7d-c9e2-47b8-b8a6-411e1c843202 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:06.294776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-1bef0c7d-c9e2-47b8-b8a6-411e1c843202 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/ada95caf-4875-4524-93f0-f33adf196c2f" status: 200 len: 194 microversion: 2.1 time: 0.042538 Nov 16 16:26:06.295565 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 639/1393] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Nov 16 16:26:06 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/ada95caf-4875-4524-93f0-f33adf196c2f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:26:06.305924 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:06.306519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:06.314209 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:06.314701 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:06.315498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:06.315927 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:06.402703 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lazy-loading 'services' on Instance uuid 807406d2-6025-4a97-a3ce-a61720020aef {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:26:06.487676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-70086327-7650-47f0-a5c4-d131cd80a8b5 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/ada95caf-4875-4524-93f0-f33adf196c2f" status: 202 len: 0 microversion: 2.1 time: 0.185196 Nov 16 16:26:06.488510 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 755/1394] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:26:06 2021] DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments/ada95caf-4875-4524-93f0-f33adf196c2f => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:06.489359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dabdba9c-fd02-4d2c-8124-b94f140e0ca1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:06.490409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dabdba9c-fd02-4d2c-8124-b94f140e0ca1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:06.501646 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dabdba9c-fd02-4d2c-8124-b94f140e0ca1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:06.502441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dabdba9c-fd02-4d2c-8124-b94f140e0ca1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:06.503795 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dabdba9c-fd02-4d2c-8124-b94f140e0ca1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:06.504389 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dabdba9c-fd02-4d2c-8124-b94f140e0ca1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:06.568368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dabdba9c-fd02-4d2c-8124-b94f140e0ca1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.086058 Nov 16 16:26:06.569103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 640/1395] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:06 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:07.583522 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4f55c4cf-a951-4b93-a925-0318a50b4ca3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:07.584530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4f55c4cf-a951-4b93-a925-0318a50b4ca3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:07.591118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f55c4cf-a951-4b93-a925-0318a50b4ca3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.591559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f55c4cf-a951-4b93-a925-0318a50b4ca3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.592365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f55c4cf-a951-4b93-a925-0318a50b4ca3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.592799 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f55c4cf-a951-4b93-a925-0318a50b4ca3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.655955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4f55c4cf-a951-4b93-a925-0318a50b4ca3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.077646 Nov 16 16:26:07.656670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 756/1396] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:07 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:07.684714 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5822e24a-66a4-414d-935e-b5a6f9c5f9ff tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:07.685716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5822e24a-66a4-414d-935e-b5a6f9c5f9ff tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:07.693573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5822e24a-66a4-414d-935e-b5a6f9c5f9ff tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.694023 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5822e24a-66a4-414d-935e-b5a6f9c5f9ff tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.694861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5822e24a-66a4-414d-935e-b5a6f9c5f9ff tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.695289 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5822e24a-66a4-414d-935e-b5a6f9c5f9ff tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.728619 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5822e24a-66a4-414d-935e-b5a6f9c5f9ff tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048548 Nov 16 16:26:07.729176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 641/1397] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:26:07 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:26:07.835098 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-275f25d7-7a57-40fa-95cb-36ce647bde12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:07.836109 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-275f25d7-7a57-40fa-95cb-36ce647bde12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:07.843844 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-275f25d7-7a57-40fa-95cb-36ce647bde12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.844296 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-275f25d7-7a57-40fa-95cb-36ce647bde12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.845412 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-275f25d7-7a57-40fa-95cb-36ce647bde12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.845859 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-275f25d7-7a57-40fa-95cb-36ce647bde12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.879112 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-275f25d7-7a57-40fa-95cb-36ce647bde12 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048279 Nov 16 16:26:07.879669 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 757/1398] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:26:07 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:26:07.935907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:07.936404 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:07.943053 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.943494 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.944259 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:07.944688 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:07.971229 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:26:08.066883 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fed86c21-4fdf-4c6e-aa47-03a8ac4c1a50 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 204 len: 0 microversion: 2.1 time: 0.132996 Nov 16 16:26:08.067528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 642/1399] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:26:07 2021] DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:26:08.077212 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:08.078061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:08.086291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:08.086773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:08.087555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:08.087983 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:08.255604 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:08.268134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d0cafa40-ae9d-4d9d-89d7-ca332e39de75 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1674 microversion: 2.1 time: 0.195822 Nov 16 16:26:08.268855 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 758/1400] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:08 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1674 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:26:08.672559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e3bc7a8d-f669-4218-906a-5b71887f4648 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:08.673809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e3bc7a8d-f669-4218-906a-5b71887f4648 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:08.682635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3bc7a8d-f669-4218-906a-5b71887f4648 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:08.683084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3bc7a8d-f669-4218-906a-5b71887f4648 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:08.683895 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3bc7a8d-f669-4218-906a-5b71887f4648 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:08.684321 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e3bc7a8d-f669-4218-906a-5b71887f4648 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:08.746682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e3bc7a8d-f669-4218-906a-5b71887f4648 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.079356 Nov 16 16:26:08.747442 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 643/1401] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:08 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:09.286551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:09.287132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:09.293980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:09.294426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:09.295215 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:09.295642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:09.436806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:09.445199 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4f8da7e1-f3cb-44fe-a46d-72ba45bd0ea8 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1674 microversion: 2.1 time: 0.162468 Nov 16 16:26:09.445780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 759/1402] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:09 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:26:09.760134 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-81c8ebf5-5620-49f4-ba0a-db6c88aa2aa3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:09.761186 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-81c8ebf5-5620-49f4-ba0a-db6c88aa2aa3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:09.769339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c8ebf5-5620-49f4-ba0a-db6c88aa2aa3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:09.769788 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c8ebf5-5620-49f4-ba0a-db6c88aa2aa3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:09.770612 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c8ebf5-5620-49f4-ba0a-db6c88aa2aa3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:09.771045 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-81c8ebf5-5620-49f4-ba0a-db6c88aa2aa3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:09.834062 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-81c8ebf5-5620-49f4-ba0a-db6c88aa2aa3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.078368 Nov 16 16:26:09.834738 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 644/1403] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:09 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:10.471237 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:10.471938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:10.478985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:10.479437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:10.480450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:10.480904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:10.762774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54ac91a208046b0ad1ab26903a289a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e41658de1c433d88953df323d876ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:10.770926 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-97385122-516e-44a5-9257-64a37206363c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 200 len: 1674 microversion: 2.1 time: 0.304507 Nov 16 16:26:10.771582 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 760/1404] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:10 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 1674 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:26:10.846208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-107668f4-65f8-4f50-a164-c5b60a922d83 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:10.847514 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-107668f4-65f8-4f50-a164-c5b60a922d83 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:10.855049 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-107668f4-65f8-4f50-a164-c5b60a922d83 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:10.855503 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-107668f4-65f8-4f50-a164-c5b60a922d83 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:10.856293 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-107668f4-65f8-4f50-a164-c5b60a922d83 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:10.856724 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-107668f4-65f8-4f50-a164-c5b60a922d83 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:10.926459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-107668f4-65f8-4f50-a164-c5b60a922d83 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.084354 Nov 16 16:26:10.930624 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 645/1405] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:10 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:11.229652 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-e6a0130d-5a94-4ee4-9e8e-ebf5398168f6 req-86f77fad-2488-4141-9ca3-b63c458b6bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807406d2-6025-4a97-a3ce-a61720020aef", "name": "network-vif-deleted", "tag": "18c69252-e6f0-45a8-81a4-fdb0eed8a2fd"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:11.231340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:26:11.231340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:26:11.239863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e6a0130d-5a94-4ee4-9e8e-ebf5398168f6 req-86f77fad-2488-4141-9ca3-b63c458b6bc5 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:11.240342 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-e6a0130d-5a94-4ee4-9e8e-ebf5398168f6 req-86f77fad-2488-4141-9ca3-b63c458b6bc5 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:11.259009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-e6a0130d-5a94-4ee4-9e8e-ebf5398168f6 req-86f77fad-2488-4141-9ca3-b63c458b6bc5 service nova] Creating event network-vif-deleted:18c69252-e6f0-45a8-81a4-fdb0eed8a2fd for instance 807406d2-6025-4a97-a3ce-a61720020aef on hv-cinder-78776 Nov 16 16:26:11.265759 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-e6a0130d-5a94-4ee4-9e8e-ebf5398168f6 req-86f77fad-2488-4141-9ca3-b63c458b6bc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039957 Nov 16 16:26:11.266609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 761/1406] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:26:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:26:11.789739 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:11.790474 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:11.798878 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:11.799334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:11.800136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:11.800570 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:11.817712 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] HTTP exception thrown: Instance 807406d2-6025-4a97-a3ce-a61720020aef could not be found. Nov 16 16:26:11.818490 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Returning 404 to user: Instance 807406d2-6025-4a97-a3ce-a61720020aef could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:26:11.819301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8cfe5266-caa7-4059-acc4-cf3324ef9ceb tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 404 len: 111 microversion: 2.1 time: 0.033762 Nov 16 16:26:11.819916 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 646/1407] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:11 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:26:11.829246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f8b4a20e-0db0-4d21-be68-0088d8c1fa15 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '.version_select at 0x7f3ec35a3c10>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:11.851189 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f8b4a20e-0db0-4d21-be68-0088d8c1fa15 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2019451357" status: 202 len: 0 microversion: 2.1 time: 0.025950 Nov 16 16:26:11.851803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 762/1408] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Nov 16 16:26:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2019451357 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:11.939610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3f96d10e-3a43-4084-b460-b88cf01b1a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:11.941091 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3f96d10e-3a43-4084-b460-b88cf01b1a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:11.948508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f96d10e-3a43-4084-b460-b88cf01b1a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:11.949272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f96d10e-3a43-4084-b460-b88cf01b1a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:11.950061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f96d10e-3a43-4084-b460-b88cf01b1a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:11.950704 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3f96d10e-3a43-4084-b460-b88cf01b1a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:12.023586 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3f96d10e-3a43-4084-b460-b88cf01b1a34 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.086970 Nov 16 16:26:12.029308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 647/1409] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:11 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:13.038641 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-76f8c580-b9be-4572-84e7-7ade962a2fb3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:13.039309 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-76f8c580-b9be-4572-84e7-7ade962a2fb3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:13.046256 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76f8c580-b9be-4572-84e7-7ade962a2fb3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:13.046766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76f8c580-b9be-4572-84e7-7ade962a2fb3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:13.047743 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76f8c580-b9be-4572-84e7-7ade962a2fb3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:13.048461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76f8c580-b9be-4572-84e7-7ade962a2fb3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:13.118766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-76f8c580-b9be-4572-84e7-7ade962a2fb3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.085022 Nov 16 16:26:13.119430 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 763/1410] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:13 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:14.134774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ae3607f8-f88a-43f7-ad7e-2dc54a78b87f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:14.135663 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ae3607f8-f88a-43f7-ad7e-2dc54a78b87f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:14.143668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae3607f8-f88a-43f7-ad7e-2dc54a78b87f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:14.144115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae3607f8-f88a-43f7-ad7e-2dc54a78b87f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:14.144975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae3607f8-f88a-43f7-ad7e-2dc54a78b87f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:14.145623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ae3607f8-f88a-43f7-ad7e-2dc54a78b87f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:14.218441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ae3607f8-f88a-43f7-ad7e-2dc54a78b87f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.088291 Nov 16 16:26:14.219363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 648/1411] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:14 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 16 16:26:14.963615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:14.964162 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:14.971671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:14.972140 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:14.972975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:14.973409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:14.990251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] HTTP exception thrown: Instance 807406d2-6025-4a97-a3ce-a61720020aef could not be found. Nov 16 16:26:14.990871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Returning 404 to user: Instance 807406d2-6025-4a97-a3ce-a61720020aef could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:26:14.991672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-391e9b28-97bb-4565-a806-f41f19709934 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 404 len: 111 microversion: 2.1 time: 0.032234 Nov 16 16:26:14.992205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 764/1412] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:26:14 2021] DELETE /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:26:15.004132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:15.005141 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 807406d2-6025-4a97-a3ce-a61720020aef] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:15.016223 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:15.016773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:15.017840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:15.018550 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:15.032548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] HTTP exception thrown: Instance 807406d2-6025-4a97-a3ce-a61720020aef could not be found. Nov 16 16:26:15.033150 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Returning 404 to user: Instance 807406d2-6025-4a97-a3ce-a61720020aef could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:26:15.034078 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8513ac41-a83f-4ebc-9f91-a64524b9bd0c tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef" status: 404 len: 111 microversion: 2.1 time: 0.036986 Nov 16 16:26:15.034639 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 649/1413] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:14 2021] GET /compute/v2.1/servers/807406d2-6025-4a97-a3ce-a61720020aef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:26:15.234686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-dbcabd28-ad3a-48a6-b63a-074b6f1a70f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:15.235944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-dbcabd28-ad3a-48a6-b63a-074b6f1a70f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:15.242859 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dbcabd28-ad3a-48a6-b63a-074b6f1a70f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:15.243300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dbcabd28-ad3a-48a6-b63a-074b6f1a70f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:15.244084 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dbcabd28-ad3a-48a6-b63a-074b6f1a70f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:15.244505 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-dbcabd28-ad3a-48a6-b63a-074b6f1a70f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:15.313129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-dbcabd28-ad3a-48a6-b63a-074b6f1a70f1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.083692 Nov 16 16:26:15.314061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 765/1414] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:15 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:16.187426 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:16.188024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:16.200057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:16.200500 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:16.201274 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:16.201707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:16.219088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] HTTP exception thrown: Instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 could not be found. Nov 16 16:26:16.219671 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Returning 404 to user: Instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:26:16.220488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e124d7fc-d13d-49cf-aed6-ccd6a8a7c8cd tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 404 len: 111 microversion: 2.1 time: 0.039155 Nov 16 16:26:16.221025 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 650/1415] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:26:16 2021] DELETE /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:26:16.229770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:16.230475 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] [instance: 5ff0d2f3-de31-4eda-aed0-b37837391d69] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:16.237899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:16.238343 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:16.239137 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:16.239560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:16.254037 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] HTTP exception thrown: Instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 could not be found. Nov 16 16:26:16.254724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] Returning 404 to user: Instance 5ff0d2f3-de31-4eda-aed0-b37837391d69 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:26:16.255528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8e08a4bb-601c-4481-900a-bc9c5066d1e1 tempest-AttachVolumeTestJSON-1045507282 tempest-AttachVolumeTestJSON-1045507282-project] 10.222.0.61 "GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69" status: 404 len: 111 microversion: 2.1 time: 0.029810 Nov 16 16:26:16.256064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 766/1416] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:16 2021] GET /compute/v2.1/servers/5ff0d2f3-de31-4eda-aed0-b37837391d69 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:26:16.325088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7d1658a5-b693-4899-ab8c-832a4ead8aaf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:16.326021 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7d1658a5-b693-4899-ab8c-832a4ead8aaf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:16.332830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d1658a5-b693-4899-ab8c-832a4ead8aaf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:16.333279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d1658a5-b693-4899-ab8c-832a4ead8aaf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:16.334047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d1658a5-b693-4899-ab8c-832a4ead8aaf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:16.334529 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7d1658a5-b693-4899-ab8c-832a4ead8aaf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:16.395771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7d1658a5-b693-4899-ab8c-832a4ead8aaf tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.074216 Nov 16 16:26:16.396754 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 651/1417] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:16 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:17.408575 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ad14264e-170c-47e8-938c-1d716068da90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:17.410316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ad14264e-170c-47e8-938c-1d716068da90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:17.417691 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad14264e-170c-47e8-938c-1d716068da90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:17.418240 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad14264e-170c-47e8-938c-1d716068da90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:17.419426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad14264e-170c-47e8-938c-1d716068da90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:17.420232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad14264e-170c-47e8-938c-1d716068da90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:17.492481 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ad14264e-170c-47e8-938c-1d716068da90 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.087727 Nov 16 16:26:17.494076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 767/1418] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:17 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:18.505930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4693147f-ba37-4acd-b28d-33689c1c5a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:18.507401 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4693147f-ba37-4acd-b28d-33689c1c5a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:18.515580 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4693147f-ba37-4acd-b28d-33689c1c5a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:18.516020 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4693147f-ba37-4acd-b28d-33689c1c5a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:18.516841 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4693147f-ba37-4acd-b28d-33689c1c5a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:18.517270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4693147f-ba37-4acd-b28d-33689c1c5a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:18.580020 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4693147f-ba37-4acd-b28d-33689c1c5a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.078090 Nov 16 16:26:18.580675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 652/1419] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:18 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:19.593790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7c8d14fa-6153-40eb-a48b-10ac702deba5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:19.595723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7c8d14fa-6153-40eb-a48b-10ac702deba5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:19.604291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c8d14fa-6153-40eb-a48b-10ac702deba5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:19.605321 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c8d14fa-6153-40eb-a48b-10ac702deba5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:19.606552 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c8d14fa-6153-40eb-a48b-10ac702deba5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:19.607179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7c8d14fa-6153-40eb-a48b-10ac702deba5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:19.674150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7c8d14fa-6153-40eb-a48b-10ac702deba5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.085045 Nov 16 16:26:19.674861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 768/1420] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:19 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:20.688228 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b58104c4-3909-4e5c-955d-6125d6edc197 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:20.689728 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b58104c4-3909-4e5c-955d-6125d6edc197 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:20.697371 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b58104c4-3909-4e5c-955d-6125d6edc197 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:20.697934 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b58104c4-3909-4e5c-955d-6125d6edc197 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:20.699032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b58104c4-3909-4e5c-955d-6125d6edc197 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:20.699587 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b58104c4-3909-4e5c-955d-6125d6edc197 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:20.764023 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b58104c4-3909-4e5c-955d-6125d6edc197 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 28624 microversion: 2.20 time: 0.081129 Nov 16 16:26:20.764696 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 653/1421] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:20 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 28624 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:21.777514 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ed2197b6-1ea8-4b93-abd4-ff4acd211fa8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:21.778707 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ed2197b6-1ea8-4b93-abd4-ff4acd211fa8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:21.786008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed2197b6-1ea8-4b93-abd4-ff4acd211fa8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:21.786565 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed2197b6-1ea8-4b93-abd4-ff4acd211fa8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:21.787353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed2197b6-1ea8-4b93-abd4-ff4acd211fa8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:21.787789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ed2197b6-1ea8-4b93-abd4-ff4acd211fa8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:21.865014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ed2197b6-1ea8-4b93-abd4-ff4acd211fa8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 29829 microversion: 2.20 time: 0.091474 Nov 16 16:26:21.865820 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 769/1422] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:21 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 29829 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:22.877745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-589e6f7f-d323-4265-a450-24d612f7d05b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:22.879149 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-589e6f7f-d323-4265-a450-24d612f7d05b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:22.886925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-589e6f7f-d323-4265-a450-24d612f7d05b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:22.887441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-589e6f7f-d323-4265-a450-24d612f7d05b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:22.888379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-589e6f7f-d323-4265-a450-24d612f7d05b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:22.888836 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-589e6f7f-d323-4265-a450-24d612f7d05b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:22.963554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-589e6f7f-d323-4265-a450-24d612f7d05b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 31930 microversion: 2.20 time: 0.089798 Nov 16 16:26:22.964510 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 654/1423] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:22 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 31930 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:23.975971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a1887428-f4a2-475b-abf7-822780cfda42 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:23.976887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a1887428-f4a2-475b-abf7-822780cfda42 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:23.983851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1887428-f4a2-475b-abf7-822780cfda42 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:23.984287 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1887428-f4a2-475b-abf7-822780cfda42 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:23.985057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1887428-f4a2-475b-abf7-822780cfda42 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:23.985480 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a1887428-f4a2-475b-abf7-822780cfda42 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:24.058789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a1887428-f4a2-475b-abf7-822780cfda42 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 33359 microversion: 2.20 time: 0.086859 Nov 16 16:26:24.059424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 770/1424] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:23 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 33359 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:25.072816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ac9448b7-ea75-44c1-813e-23e260f76b30 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:25.073820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ac9448b7-ea75-44c1-813e-23e260f76b30 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:25.081753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac9448b7-ea75-44c1-813e-23e260f76b30 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:25.082295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac9448b7-ea75-44c1-813e-23e260f76b30 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:25.083201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac9448b7-ea75-44c1-813e-23e260f76b30 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:25.083633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ac9448b7-ea75-44c1-813e-23e260f76b30 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:25.160234 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ac9448b7-ea75-44c1-813e-23e260f76b30 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 34370 microversion: 2.20 time: 0.091486 Nov 16 16:26:25.160859 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 655/1425] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:25 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 34370 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:26.173280 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-74d6fcaa-c6bf-455a-9d22-73f0ed0515bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:26.174422 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-74d6fcaa-c6bf-455a-9d22-73f0ed0515bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:26.181897 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74d6fcaa-c6bf-455a-9d22-73f0ed0515bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:26.182351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74d6fcaa-c6bf-455a-9d22-73f0ed0515bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:26.183205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74d6fcaa-c6bf-455a-9d22-73f0ed0515bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:26.183617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74d6fcaa-c6bf-455a-9d22-73f0ed0515bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:26.258892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-74d6fcaa-c6bf-455a-9d22-73f0ed0515bc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 35582 microversion: 2.20 time: 0.089427 Nov 16 16:26:26.259842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 771/1426] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:26 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 35582 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:27.276602 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a929bac1-370c-418d-922f-e4b9b089d593 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:27.278270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a929bac1-370c-418d-922f-e4b9b089d593 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:27.289175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a929bac1-370c-418d-922f-e4b9b089d593 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:27.289625 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a929bac1-370c-418d-922f-e4b9b089d593 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:27.290408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a929bac1-370c-418d-922f-e4b9b089d593 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:27.290869 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a929bac1-370c-418d-922f-e4b9b089d593 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:27.363763 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a929bac1-370c-418d-922f-e4b9b089d593 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 37128 microversion: 2.20 time: 0.094548 Nov 16 16:26:27.364456 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 656/1427] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:27 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 37128 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:28.379895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a6dcebda-44d9-46d3-a05a-4c67eff9b66e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:28.380956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a6dcebda-44d9-46d3-a05a-4c67eff9b66e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:28.388970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6dcebda-44d9-46d3-a05a-4c67eff9b66e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:28.389452 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6dcebda-44d9-46d3-a05a-4c67eff9b66e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:28.390399 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6dcebda-44d9-46d3-a05a-4c67eff9b66e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:28.390860 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a6dcebda-44d9-46d3-a05a-4c67eff9b66e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:28.465359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a6dcebda-44d9-46d3-a05a-4c67eff9b66e tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 38178 microversion: 2.20 time: 0.092709 Nov 16 16:26:28.467084 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 772/1428] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:28 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 38178 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:29.478086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7e8fd22b-2ff1-4fa9-8d88-ee3c64d97dc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:29.479169 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7e8fd22b-2ff1-4fa9-8d88-ee3c64d97dc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:29.486257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e8fd22b-2ff1-4fa9-8d88-ee3c64d97dc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:29.486716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e8fd22b-2ff1-4fa9-8d88-ee3c64d97dc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:29.487491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e8fd22b-2ff1-4fa9-8d88-ee3c64d97dc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:29.487919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e8fd22b-2ff1-4fa9-8d88-ee3c64d97dc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:29.552726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7e8fd22b-2ff1-4fa9-8d88-ee3c64d97dc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 38178 microversion: 2.20 time: 0.078846 Nov 16 16:26:29.557043 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 657/1429] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:29 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 38178 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:30.565457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5631ca43-32cc-440f-a575-16d6745b17b4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:30.566403 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5631ca43-32cc-440f-a575-16d6745b17b4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:30.573132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5631ca43-32cc-440f-a575-16d6745b17b4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:30.573594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5631ca43-32cc-440f-a575-16d6745b17b4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:30.574371 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5631ca43-32cc-440f-a575-16d6745b17b4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:30.574828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5631ca43-32cc-440f-a575-16d6745b17b4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:30.643872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5631ca43-32cc-440f-a575-16d6745b17b4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 38178 microversion: 2.20 time: 0.082340 Nov 16 16:26:30.644551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 773/1430] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:30 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 38178 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:31.659013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-68cfadc5-69a2-46db-a4c9-bb2109a28be0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:31.660042 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-68cfadc5-69a2-46db-a4c9-bb2109a28be0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:31.668858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68cfadc5-69a2-46db-a4c9-bb2109a28be0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:31.669317 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68cfadc5-69a2-46db-a4c9-bb2109a28be0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:31.670076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68cfadc5-69a2-46db-a4c9-bb2109a28be0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:31.670543 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68cfadc5-69a2-46db-a4c9-bb2109a28be0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:31.743054 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-68cfadc5-69a2-46db-a4c9-bb2109a28be0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 38178 microversion: 2.20 time: 0.090080 Nov 16 16:26:31.743759 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 658/1431] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:31 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 38178 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:32.757772 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-eaa32e11-3d6b-4108-b337-802a44dccfed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:32.759272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-eaa32e11-3d6b-4108-b337-802a44dccfed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:32.766487 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eaa32e11-3d6b-4108-b337-802a44dccfed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:32.767044 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eaa32e11-3d6b-4108-b337-802a44dccfed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:32.767848 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eaa32e11-3d6b-4108-b337-802a44dccfed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:32.768282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-eaa32e11-3d6b-4108-b337-802a44dccfed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:32.850275 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-eaa32e11-3d6b-4108-b337-802a44dccfed tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 200 len: 38319 microversion: 2.20 time: 0.096280 Nov 16 16:26:32.850934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 774/1432] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:32 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 38319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:26:32.864997 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a224080b-8f30-40be-ab9f-99cf31c726ff tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:32.865617 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a224080b-8f30-40be-ab9f-99cf31c726ff tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:32.873789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a224080b-8f30-40be-ab9f-99cf31c726ff tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:32.874168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a224080b-8f30-40be-ab9f-99cf31c726ff tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:32.874957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a224080b-8f30-40be-ab9f-99cf31c726ff tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:32.875397 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a224080b-8f30-40be-ab9f-99cf31c726ff tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:32.909043 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a224080b-8f30-40be-ab9f-99cf31c726ff tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/ips" status: 200 len: 153 microversion: 2.20 time: 0.050834 Nov 16 16:26:32.909623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 659/1433] 10.222.0.61 () {60 vars in 1288 bytes} [Tue Nov 16 16:26:32 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/ips => generated 153 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:26:34.989956 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:34.990640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:34.997424 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:34.997866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:34.998718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:34.999148 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:35.022533 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lazy-loading 'flavor' on Instance uuid 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:26:35.293169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5aba5264-95e6-494a-a21b-e383518c1ba7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 202 len: 0 microversion: 2.20 time: 0.307282 Nov 16 16:26:35.294165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 775/1434] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:26:34 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 16 16:26:35.302603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:35.303899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:35.311415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:35.312377 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:35.313412 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:35.313916 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:35.451097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:35.459526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:35.461011 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:35.462210 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5c9d8361-e1f2-4134-8b00-767307cc01df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.163483 Nov 16 16:26:35.462858 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 660/1435] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:35 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:26:36.481884 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:36.482522 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:36.489064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:36.489499 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:36.490258 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:36.490726 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:36.634250 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:36.642848 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:36.644351 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:36.645561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-09739624-5704-4590-baf9-e9adeff5e565 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.168346 Nov 16 16:26:36.646339 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 776/1436] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:36 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:37.664917 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:37.665683 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:37.673524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:37.674185 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:37.674903 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:37.675367 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:37.870408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:37.880007 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:37.881870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:37.883672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-086711e4-9c62-4bac-a0ee-7730b3cf68fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.222349 Nov 16 16:26:37.884237 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 661/1437] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:37 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:38.902795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:38.903406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:38.910305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:38.910798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:38.911590 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:38.912060 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:39.054459 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:39.067773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:39.069966 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:39.071729 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e87b6e99-9f08-4ff8-bb82-8a89efe5b668 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.172494 Nov 16 16:26:39.072542 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 777/1438] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:38 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:40.091076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:40.091692 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:40.098279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:40.098908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:40.099692 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:40.100130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:40.236273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:40.244285 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:40.245815 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:40.247184 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8d3ac547-9355-445a-83c3-352f2b9f49e8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.160405 Nov 16 16:26:40.247762 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 662/1439] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:40 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:41.267181 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:41.267766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:41.274097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:41.274580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:41.275352 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:41.275785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:41.416230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:41.425062 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:41.426789 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:41.428468 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bb846aa3-032d-47cf-a521-fffe53a05c7d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.165333 Nov 16 16:26:41.429213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 778/1440] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:41 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:42.447467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:42.448098 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:42.455199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:42.455645 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:42.456432 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:42.456843 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:42.600797 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:42.609457 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:42.611395 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:42.612894 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a0f1c7d8-0e6b-478f-a321-db8b5fcc8d19 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.169336 Nov 16 16:26:42.618076 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 663/1441] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:42 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:43.634274 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:43.634914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:43.643555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:43.643937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:43.644726 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:43.645156 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:43.792930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:43.801316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:43.802868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:43.804066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2b53a9fe-1e5a-49fe-a897-ecf86edadc38 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.175942 Nov 16 16:26:43.804882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 779/1442] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:43 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:44.823083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:44.823680 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:44.830907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:44.831334 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:44.832118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:44.832546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:44.970488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:44.979230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:44.980720 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:44.981890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-40a3f593-37a1-45ff-bed4-6110c076818b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.162782 Nov 16 16:26:44.982471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 664/1443] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:44 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:46.004495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:46.009026 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:46.021115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:46.021567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:46.022355 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:46.022815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:46.164324 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:46.176383 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:46.178715 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:46.180438 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e3259c13-13b5-4e12-a1db-b9d646a5bab0 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.182014 Nov 16 16:26:46.181205 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 780/1444] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:45 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:47.204208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:47.204977 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:47.211741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:47.212196 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:47.212993 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:47.213430 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:47.371950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:47.386855 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:47.388339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:47.389819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fb0640a1-c8c3-4645-bea6-11f32464d037 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.192275 Nov 16 16:26:47.390546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 665/1445] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:47 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:48.408725 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:48.409398 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:48.416183 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:48.416631 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:48.417402 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:48.417830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:48.552018 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:48.559823 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:48.561307 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:48.562492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b19d7acd-dc00-4441-a0f6-e37ed85c9c7b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.157937 Nov 16 16:26:48.563044 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 781/1446] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:48 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:49.581771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:49.582398 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:49.589208 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:49.589664 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:49.590498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:49.590936 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:49.753859 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:49.763885 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:49.765788 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:49.767191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-38393e16-1641-4af7-9f91-c46b0b597fc4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.189759 Nov 16 16:26:49.768701 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 666/1447] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:49 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:50.791358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:50.792393 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:50.799008 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:50.799608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:50.800489 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:50.800976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:50.936773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:50.944679 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:50.946194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:50.947409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-062c7006-fa3b-41eb-9f08-aa45baad5b9f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1746 microversion: 2.20 time: 0.161737 Nov 16 16:26:50.947958 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 782/1448] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:50 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:51.969813 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:51.970824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:51.981742 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:51.982534 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:51.983788 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:51.984498 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:52.135024 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:52.143639 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:52.145141 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:52.146354 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ced06dd0-27ea-401f-86b2-a8f066441313 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1746 microversion: 2.20 time: 0.182705 Nov 16 16:26:52.147051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 667/1449] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:51 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:53.177947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:53.178548 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:53.185230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:53.185744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:53.186630 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:53.187120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:53.327272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:53.335457 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:53.336998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:53.338157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-15983e6a-16ba-46d7-81ac-4aaa3e8a85fb tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1746 microversion: 2.20 time: 0.164165 Nov 16 16:26:53.338780 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 783/1450] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:53 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:54.357994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:54.358722 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:54.365728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:54.366144 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:54.366950 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:54.367724 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:54.468057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-e73689f3-c567-4474-859c-c5b40b4f0bf8 req-6535eb31-61f9-40b9-b8cf-6592b0ebd112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee31bfd-6eb9-42f2-86b4-f6de92582bd6", "name": "network-vif-plugged", "status": "completed", "tag": "1371c66f-3f9f-467f-8620-20b01c600c30"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:54.469636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:26:54.469636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:26:54.477234 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-e73689f3-c567-4474-859c-c5b40b4f0bf8 req-6535eb31-61f9-40b9-b8cf-6592b0ebd112 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:54.477671 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-e73689f3-c567-4474-859c-c5b40b4f0bf8 req-6535eb31-61f9-40b9-b8cf-6592b0ebd112 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:54.489135 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-e73689f3-c567-4474-859c-c5b40b4f0bf8 req-6535eb31-61f9-40b9-b8cf-6592b0ebd112 service nova] Creating event network-vif-plugged:1371c66f-3f9f-467f-8620-20b01c600c30 for instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 on hv-cinder-78776 Nov 16 16:26:54.494710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-e73689f3-c567-4474-859c-c5b40b4f0bf8 req-6535eb31-61f9-40b9-b8cf-6592b0ebd112 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176152 Nov 16 16:26:54.495605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 668/1451] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:26:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:26:54.512928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:54.520833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:54.522304 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:54.523500 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-81c0c2de-fd15-4010-a760-08dcedd55a76 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1746 microversion: 2.20 time: 0.170447 Nov 16 16:26:54.524057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 784/1452] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:54 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:55.548446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:55.549488 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:55.557527 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:55.557992 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:55.558773 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:55.559197 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:55.700559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:55.709344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:55.710906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:55.712101 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4685b834-8968-41f1-8c6a-552587a61bbc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1746 microversion: 2.20 time: 0.170998 Nov 16 16:26:55.712675 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 669/1453] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:55 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:56.455428 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1942648518", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1284105524", "security_groups": [{"name": "tempest-secgroup-smoke-251262737"}], "block_device_mapping_v2": [{"uuid": "a3262745-cfbb-40ba-8853-6676fd17d892", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8ae9b94e-5cd6-4cea-ac09-979515cf0294"}]}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:26:56.594426 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] validate_networks() for [('8ae9b94e-5cd6-4cea-ac09-979515cf0294', None, None, None, None, None)] {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:26:56.735746 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:56.736353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:56.743938 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:56.744917 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:56.745758 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:56.746194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:56.957906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:56.966592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:56.970359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:56.980476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-070a04a6-f9b0-412c-a132-de7f3ec865ec tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.251391 Nov 16 16:26:56.995476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 670/1454] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:56 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:57.166317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:26:57.166870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:26:57.169573 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:26:57.170090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:26:57.170581 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:26:57.181461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:57.181944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:57.183024 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:57.183478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:57.201247 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:26:57.205639 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Getting quotas for user bd94e07e5a7d49398e9118053fc13c69 and project 497aa262344a4be5a0fd2fb5e66015c5. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:26:57.279828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:26:57.282134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3262745-cfbb-40ba-8853-6676fd17d892',volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:26:57.440822 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [be283e7a-7095-4204-bb2c-1720403c31f9] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 16 16:26:58.000120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:58.001421 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:58.009285 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:58.010042 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:58.010833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:58.011269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:58.160218 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:58.181445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:58.184341 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:58.186310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f990f7d3-3cce-49de-be1c-b1c0e5631333 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.189656 Nov 16 16:26:58.187651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 671/1455] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:57 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:26:58.458769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO oslo.messaging._drivers.impl_rabbit [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [be283e7a-7095-4204-bb2c-1720403c31f9] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 42202. Nov 16 16:26:58.469589 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-54e7cc9e-09f1-420a-8dee-c00017663541 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.017855 Nov 16 16:26:58.471006 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 785/1456] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:26:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 2020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:26:58.481432 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-59452bf0-319b-4954-98bd-13306183c0b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:58.482039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-59452bf0-319b-4954-98bd-13306183c0b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:58.559043 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-59452bf0-319b-4954-98bd-13306183c0b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:58.569480 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-59452bf0-319b-4954-98bd-13306183c0b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1095 microversion: 2.1 time: 0.091870 Nov 16 16:26:58.570084 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 672/1457] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:58 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:26:59.209618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:59.210754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:59.218629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:59.219182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:59.220073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:59.220563 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:59.372946 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:59.393636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:59.395801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:59.397901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-785e167c-fc4f-4cff-82ae-57c452a0abbd tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.195215 Nov 16 16:26:59.398899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 786/1458] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:26:59 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:26:59.587403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:26:59.588592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:26:59.597243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:59.597825 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:59.599039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:26:59.599666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:26:59.741745 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:26:59.788979 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-cb465d30-a635-48e5-9866-4876c80235f6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1201 microversion: 2.1 time: 0.205772 Nov 16 16:26:59.790187 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 673/1459] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:26:59 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1201 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:00.418841 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:00.420104 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:00.428707 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:00.429511 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:00.430699 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:00.431373 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:00.650970 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:00.660647 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:00.662657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:00.664128 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-39ac0b32-dd24-4360-98f5-fdaf4ad9c734 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.251034 Nov 16 16:27:00.665560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 787/1460] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:00 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:00.809508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:00.810288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:00.821068 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:00.821517 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:00.822344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:00.829361 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:01.163400 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:01.171621 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c5443773-65ff-42b7-8f89-f73b531fca1d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.367449 Nov 16 16:27:01.180637 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 674/1461] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:00 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:01.686623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:01.687315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:01.693906 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:01.695177 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:01.696560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:01.697088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:01.959897 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:01.993476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:01.994995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:02.001169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1eb2ebf9-2a35-443d-a167-0eff359bf284 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.318432 Nov 16 16:27:02.013440 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 788/1462] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:01 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:02.198531 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:02.199136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:02.206265 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:02.206573 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:02.207375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:02.207804 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:02.295772 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-f99c80f0-81b5-4612-ba51-bea9e6ff0f8f req-70751c3b-ef74-4a6c-a1e3-2395910788e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb95e3f-aa14-4dc0-921f-1b5890e099a9", "tag": "ce557352-37ed-45c9-9e08-6192caa333f3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:02.297354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:02.297354 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:27:02.306359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-f99c80f0-81b5-4612-ba51-bea9e6ff0f8f req-70751c3b-ef74-4a6c-a1e3-2395910788e2 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:02.306841 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-f99c80f0-81b5-4612-ba51-bea9e6ff0f8f req-70751c3b-ef74-4a6c-a1e3-2395910788e2 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:02.332478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-f99c80f0-81b5-4612-ba51-bea9e6ff0f8f req-70751c3b-ef74-4a6c-a1e3-2395910788e2 service nova] Creating event network-changed:ce557352-37ed-45c9-9e08-6192caa333f3 for instance 4fb95e3f-aa14-4dc0-921f-1b5890e099a9 on hv-cinder-78776 Nov 16 16:27:02.341895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-f99c80f0-81b5-4612-ba51-bea9e6ff0f8f req-70751c3b-ef74-4a6c-a1e3-2395910788e2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049726 Nov 16 16:27:02.345010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 789/1463] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:27:02.608320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:02.616100 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-762e47ab-0bf1-40be-8df1-2d3a48e63d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.422823 Nov 16 16:27:02.616657 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 675/1464] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:02 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:03.020291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:03.021277 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:03.028389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:03.029191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:03.030397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:03.031034 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:03.297561 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:03.312655 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:03.315328 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:03.316856 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9f5bc714-69e9-4a04-a9df-14cad3e97c9a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.301064 Nov 16 16:27:03.319709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 790/1465] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:03 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:27:03.633044 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:03.633970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:03.643396 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:03.644183 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:03.645161 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:03.645605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:03.932029 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:03.940892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-87cdfcd7-c25d-40b6-a476-b7dfceace6bb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.311748 Nov 16 16:27:03.941616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 676/1466] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:03 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:04.339987 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:04.343744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:04.353049 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:04.354099 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:04.355382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:04.355928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:04.570962 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:04.581766 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:04.584118 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:04.585326 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1824f34b-0900-49d5-b7ff-b0a4eda9f127 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.253294 Nov 16 16:27:04.586226 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 791/1467] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:04 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:04.957487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:04.959318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:04.968136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:04.969175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:04.970557 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:04.971339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:05.149403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:05.157655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ecb29d43-1403-40ee-b69e-a9b0d016d02a tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.203789 Nov 16 16:27:05.158409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 677/1468] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:04 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:05.604388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:05.605017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:05.612157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:05.612853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:05.614615 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:05.615288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:05.780056 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:05.791191 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:05.793976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:05.795802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e5e10cb5-92c9-4604-b055-0f612c7de9cc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.195671 Nov 16 16:27:05.797114 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 792/1469] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:05 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:06.175236 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:06.175897 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:06.183132 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:06.183726 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:06.184542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:06.184968 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:06.349538 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:06.357431 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b187e51c-1334-4996-8854-77abc493fe4c tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.186087 Nov 16 16:27:06.358559 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 678/1470] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:06 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:06.823611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:06.824717 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:06.833627 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:06.834076 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:06.834894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:06.835560 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:07.019887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:07.030479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:07.032383 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:07.033648 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bcc92a62-88c5-4a3f-833d-d01db10b40c7 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.221153 Nov 16 16:27:07.034207 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 793/1471] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:06 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:07.375849 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:07.376459 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:07.383058 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:07.384175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:07.384603 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:07.385038 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:07.531641 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:07.539758 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-531ffe42-cd61-4b26-ab30-ef57c2d22f6f tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.167509 Nov 16 16:27:07.540335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 679/1472] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:07 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:08.054975 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:08.055594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:08.062169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:08.062642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:08.063414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:08.063842 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:08.203477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:08.211707 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:08.213180 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:08.214345 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ffc5dd6e-5a2f-4821-b222-cc8b45097cef tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1741 microversion: 2.20 time: 0.163698 Nov 16 16:27:08.214937 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 794/1473] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:08 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:08.556669 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:08.557269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:08.567633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:08.568135 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:08.568927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:08.569353 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:08.773022 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:08.781677 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5eaa2838-8ccf-41fa-b46d-73cbffe8db93 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.228986 Nov 16 16:27:08.791874 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 680/1474] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:08 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:09.233550 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:09.234408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:09.241311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:09.241843 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:09.242754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:09.243252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:09.381070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:09.391622 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:09.393104 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:09.394303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-3bb3ec9e-cddf-4e86-8219-bc40502b53fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1723 microversion: 2.20 time: 0.164762 Nov 16 16:27:09.394911 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 795/1475] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:09 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:09.799057 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:09.799673 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:09.806676 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:09.807125 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:09.807916 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:09.808352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:09.948313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:09.955776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bf2c1845-4b60-4258-9a98-d6de825c39f2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.160455 Nov 16 16:27:09.956372 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 681/1476] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:09 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:10.414305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:10.415045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:10.421436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:10.422039 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:10.422938 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:10.423490 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:10.550832 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-d1c4e58e-868e-4731-b5b4-52120459203a req-130ceef1-2335-498b-a678-b91709de61a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee31bfd-6eb9-42f2-86b4-f6de92582bd6", "name": "network-vif-unplugged", "status": "completed", "tag": "1371c66f-3f9f-467f-8620-20b01c600c30"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:10.553291 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:10.553291 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:27:10.561326 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-d1c4e58e-868e-4731-b5b4-52120459203a req-130ceef1-2335-498b-a678-b91709de61a5 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:10.562071 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-d1c4e58e-868e-4731-b5b4-52120459203a req-130ceef1-2335-498b-a678-b91709de61a5 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:10.573159 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:10.574599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-d1c4e58e-868e-4731-b5b4-52120459203a req-130ceef1-2335-498b-a678-b91709de61a5 service nova] Creating event network-vif-unplugged:1371c66f-3f9f-467f-8620-20b01c600c30 for instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 on hv-cinder-78776 Nov 16 16:27:10.580964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-d1c4e58e-868e-4731-b5b4-52120459203a req-130ceef1-2335-498b-a678-b91709de61a5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033714 Nov 16 16:27:10.581706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:10.582737 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 682/1477] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:27:10.583332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:10.584539 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e97d8ac4-d09f-4df1-9c7e-18b6fd271582 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1723 microversion: 2.20 time: 0.174817 Nov 16 16:27:10.585285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 796/1478] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:10 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:10.976607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:10.977508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:10.985964 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:10.986659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:10.987699 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:10.988295 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:11.138634 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:11.147666 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6640e302-b24a-4f47-86d7-d7f17fd308b2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.177241 Nov 16 16:27:11.150779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 683/1479] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:10 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:11.486533 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:27:11.486881 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: Tue Nov 16 16:27:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:27:11.604096 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:11.605171 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:11.615272 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:11.615840 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:11.616790 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:11.617194 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:11.753735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:11.762196 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:11.763723 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:11.764908 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c69f3fad-da9f-4ad1-bf26-a82c21b4c8d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1666 microversion: 2.20 time: 0.165567 Nov 16 16:27:11.765461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 797/1480] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:11 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:11.782863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7abe2a0b-5e44-4d2e-ab6f-2eb6729837d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8eb2bd0-3127-4746-a26a-b63bbc87a3da"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:11.783995 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7abe2a0b-5e44-4d2e-ab6f-2eb6729837d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:11.785227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-734398314", "imageRef": "7c46ce45-907f-49fb-82fa-cfd0ca7f2934", "flavorRef": "452"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:11.790840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7abe2a0b-5e44-4d2e-ab6f-2eb6729837d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:11.791288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7abe2a0b-5e44-4d2e-ab6f-2eb6729837d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:11.792094 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7abe2a0b-5e44-4d2e-ab6f-2eb6729837d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:11.792505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7abe2a0b-5e44-4d2e-ab6f-2eb6729837d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:11.835454 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.network.neutron [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] validate_networks() for None {{(pid=116167) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:27:12.084487 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7abe2a0b-5e44-4d2e-ab6f-2eb6729837d5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305342 Nov 16 16:27:12.085257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 684/1481] 10.222.0.61 () {62 vars in 1363 bytes} [Tue Nov 16 16:27:11 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 16 16:27:12.116129 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Flavor limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:27:12.116619 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Image limits 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:27:12.117084 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Flavor pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:27:12.117492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Image pref 0:0:0 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:27:12.117914 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.virt.hardware [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116167) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:27:12.127476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.127939 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.128770 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.129202 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.146476 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Getting quotas for project 72e5c6e5706e4b7ead082ca6eab239c0. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:27:12.150316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Getting quotas for user 0fd141b9ee3f4b9497a61a516b0f0a7b and project 72e5c6e5706e4b7ead082ca6eab239c0. Resources: {'instances', 'ram', 'cores'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:27:12.161433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Going to run 1 instances... {{(pid=116167) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:27:12.164106 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c46ce45-907f-49fb-82fa-cfd0ca7f2934',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116167) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:27:12.165315 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:12.165948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:12.172925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.173356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.174133 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.174590 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.214462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-66891700-9f16-471b-85a9-948c14c0fac5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.432890 Nov 16 16:27:12.220204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 798/1482] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:27:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 16 16:27:12.220204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-c8e9e4ef-fa3a-486a-ac77-c5e422ebcc88 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:12.220738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-c8e9e4ef-fa3a-486a-ac77-c5e422ebcc88 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:12.226946 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c8e9e4ef-fa3a-486a-ac77-c5e422ebcc88 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.227388 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c8e9e4ef-fa3a-486a-ac77-c5e422ebcc88 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.228189 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c8e9e4ef-fa3a-486a-ac77-c5e422ebcc88 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.228609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-c8e9e4ef-fa3a-486a-ac77-c5e422ebcc88 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.334900 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:12.343612 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ea561940-6fca-4d80-aa3b-3cee81e7f5eb tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.182127 Nov 16 16:27:12.354860 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 685/1483] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:12 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:12.360242 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e0ac0cac-544a-4201-84fd-8a890aa4a6e6 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:12.360892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e0ac0cac-544a-4201-84fd-8a890aa4a6e6 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:12.431630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e0ac0cac-544a-4201-84fd-8a890aa4a6e6 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:12.439378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e0ac0cac-544a-4201-84fd-8a890aa4a6e6 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1214 microversion: 2.1 time: 0.083446 Nov 16 16:27:12.439988 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 686/1484] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:12 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:12.524378 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-c8e9e4ef-fa3a-486a-ac77-c5e422ebcc88 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-volume_attachments/c8eb2bd0-3127-4746-a26a-b63bbc87a3da" status: 202 len: 0 microversion: 2.20 time: 0.307603 Nov 16 16:27:12.524923 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 799/1485] 10.222.0.61 () {60 vars in 1456 bytes} [Tue Nov 16 16:27:12 2021] DELETE /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-volume_attachments/c8eb2bd0-3127-4746-a26a-b63bbc87a3da => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:27:12.583973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3a965988-edad-48f6-8a28-b7d8c67888ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:12.584687 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3a965988-edad-48f6-8a28-b7d8c67888ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:12.591854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a965988-edad-48f6-8a28-b7d8c67888ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.592453 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a965988-edad-48f6-8a28-b7d8c67888ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.593655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a965988-edad-48f6-8a28-b7d8c67888ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.594434 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3a965988-edad-48f6-8a28-b7d8c67888ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.617606 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-1eabf54b-209a-441e-89e4-be0df11b9499 req-651c8672-0436-47b6-8cf8-c7165993cead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb95e3f-aa14-4dc0-921f-1b5890e099a9", "name": "network-vif-plugged", "status": "completed", "tag": "ce557352-37ed-45c9-9e08-6192caa333f3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:12.620097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:12.620097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:27:12.629003 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1eabf54b-209a-441e-89e4-be0df11b9499 req-651c8672-0436-47b6-8cf8-c7165993cead service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.629530 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1eabf54b-209a-441e-89e4-be0df11b9499 req-651c8672-0436-47b6-8cf8-c7165993cead service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.643467 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-1eabf54b-209a-441e-89e4-be0df11b9499 req-651c8672-0436-47b6-8cf8-c7165993cead service nova] Creating event network-vif-plugged:ce557352-37ed-45c9-9e08-6192caa333f3 for instance 4fb95e3f-aa14-4dc0-921f-1b5890e099a9 on hv-cinder-78776 Nov 16 16:27:12.649616 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-1eabf54b-209a-441e-89e4-be0df11b9499 req-651c8672-0436-47b6-8cf8-c7165993cead service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035367 Nov 16 16:27:12.650235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 800/1486] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:27:12.685460 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3a965988-edad-48f6-8a28-b7d8c67888ba tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action" status: 202 len: 0 microversion: 2.20 time: 0.105125 Nov 16 16:27:12.690102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 687/1487] 10.222.0.61 () {62 vars in 1318 bytes} [Tue Nov 16 16:27:12 2021] POST /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:27:12.697288 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:12.698898 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:12.707300 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.708175 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.709971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:12.710551 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:12.907718 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:12.916818 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:12.918311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:12.919508 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f4af8cd9-4ea3-45b7-8215-4253ec95f864 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1674 microversion: 2.20 time: 0.228361 Nov 16 16:27:12.932203 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 801/1488] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:12 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1674 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:27:13.362707 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:13.363297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:13.369521 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:13.369951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:13.370989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:13.371419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:13.456955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:13.457642 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:13.464230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:13.464670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:13.465440 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:13.465868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:13.549186 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:13.552075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:13.559275 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4eed2f59-41c8-4396-af01-b02b06e63fcf tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1266 microversion: 2.1 time: 0.105911 Nov 16 16:27:13.559954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 802/1489] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:13 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:27:13.560660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a8cb5de0-a48d-4d86-845b-e3391ec12917 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1266 microversion: 2.1 time: 0.203140 Nov 16 16:27:13.561695 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 688/1490] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:13 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:13.939414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:13.940038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:13.946283 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:13.946765 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:13.947738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:13.948169 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:14.202955 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:14.212336 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:14.214120 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:14.215348 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-67fa6172-9d27-4051-964e-a8bb6130e899 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.280017 Nov 16 16:27:14.216395 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 803/1491] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:13 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:14.578838 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:14.584851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:14.585738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:14.586852 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:14.596786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:14.600945 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:14.601903 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:14.602635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:14.604359 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:14.605302 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:14.605833 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:14.609462 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:15.321450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:15.323715 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:15.332890 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a50f91a7-802e-49c6-86d7-5c5d5ea27c60 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1451 microversion: 2.1 time: 0.758513 Nov 16 16:27:15.333461 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-248837c4-515c-4fcb-83c7-764450ee2a87 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.751668 Nov 16 16:27:15.334127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 804/1492] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:14 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:15.345316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:15.348285 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 689/1493] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:14 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1451 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:15.348709 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:15.354172 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:15.355098 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:15.360346 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:15.361442 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:15.361662 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:15.362287 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:15.363288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:15.363884 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:15.373320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:15.373991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:15.778301 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:15.787244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:15.789210 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:15.790754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-9e80c94d-e16b-4240-8bd8-ed5460913391 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.452276 Nov 16 16:27:15.791626 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 805/1494] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:15 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:15.801435 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:15.810676 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3967beef-f409-4802-a7f8-17db328159c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1451 microversion: 2.1 time: 0.460909 Nov 16 16:27:15.823857 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 690/1495] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:15 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1451 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:16.040804 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-1902c5b7-0847-4696-8016-1d784049ba6d req-a67a6e8e-77e6-403a-9b6d-84cc9fc7fd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03ef9489-0006-48d1-bc60-cd24f39a8565", "tag": "f3a5ab22-3b7f-4e40-9d02-b50b04e13c8c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:16.042871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:16.042871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:27:16.051917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1902c5b7-0847-4696-8016-1d784049ba6d req-a67a6e8e-77e6-403a-9b6d-84cc9fc7fd82 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:16.052592 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1902c5b7-0847-4696-8016-1d784049ba6d req-a67a6e8e-77e6-403a-9b6d-84cc9fc7fd82 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:16.066259 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-1902c5b7-0847-4696-8016-1d784049ba6d req-a67a6e8e-77e6-403a-9b6d-84cc9fc7fd82 service nova] Creating event network-changed:f3a5ab22-3b7f-4e40-9d02-b50b04e13c8c for instance 03ef9489-0006-48d1-bc60-cd24f39a8565 on hv-cinder-78776 Nov 16 16:27:16.072163 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-1902c5b7-0847-4696-8016-1d784049ba6d req-a67a6e8e-77e6-403a-9b6d-84cc9fc7fd82 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035660 Nov 16 16:27:16.073429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 806/1496] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:27:16.351461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:16.351982 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:16.357800 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:16.358519 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:16.359297 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:16.359733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:16.603241 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:16.615408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c31c9d5e-4012-455b-99e4-fcca406c76e7 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.267760 Nov 16 16:27:16.616373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 691/1497] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:16 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:16.811214 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:16.812785 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:16.819493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:16.820617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:16.821491 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:16.825366 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:17.156435 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:17.164762 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:17.166248 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:17.167462 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ad0ec67d-a2fd-4b01-affb-28bc2df5669b tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.360760 Nov 16 16:27:17.168036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 807/1498] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:16 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:17.633840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:17.634579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:17.641174 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:17.641691 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:17.642544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:17.643059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:17.895364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:17.902889 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7172e741-d722-45e2-beb1-0bcf8dd740da tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.273775 Nov 16 16:27:17.903534 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 692/1499] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:17 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:18.100477 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-a3beb959-7d43-45d1-bef0-9050b5feab32 req-fbeda6f9-7cb9-45cb-b6ac-c5035da946ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb95e3f-aa14-4dc0-921f-1b5890e099a9", "tag": "ce557352-37ed-45c9-9e08-6192caa333f3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:18.103173 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:18.103173 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:27:18.113244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a3beb959-7d43-45d1-bef0-9050b5feab32 req-fbeda6f9-7cb9-45cb-b6ac-c5035da946ac service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:18.115121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-a3beb959-7d43-45d1-bef0-9050b5feab32 req-fbeda6f9-7cb9-45cb-b6ac-c5035da946ac service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:18.129028 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-a3beb959-7d43-45d1-bef0-9050b5feab32 req-fbeda6f9-7cb9-45cb-b6ac-c5035da946ac service nova] Creating event network-changed:ce557352-37ed-45c9-9e08-6192caa333f3 for instance 4fb95e3f-aa14-4dc0-921f-1b5890e099a9 on hv-cinder-78776 Nov 16 16:27:18.135443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-a3beb959-7d43-45d1-bef0-9050b5feab32 req-fbeda6f9-7cb9-45cb-b6ac-c5035da946ac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039059 Nov 16 16:27:18.136676 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 808/1500] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:27:18.185364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:18.185969 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:18.191828 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:18.192271 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:18.193073 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:18.193501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:18.371313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:18.386526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:18.388124 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:18.389385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-434618dd-7c4b-4da4-8598-5f60be42794f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.208149 Nov 16 16:27:18.390059 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 693/1501] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:18 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:18.921167 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:18.921868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:18.928658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:18.929193 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:18.929985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:18.930444 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:19.102087 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:19.112498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ea5b1e30-0ac8-4a01-86a3-daaff8bff70b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.195350 Nov 16 16:27:19.113710 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 809/1502] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:18 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:19.408717 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:19.410357 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:19.418751 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:19.420006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:19.421445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:19.422182 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:19.561263 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:19.569362 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:19.571130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:19.572501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-14f08538-6de9-4679-94cf-805917cea6a1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.167866 Nov 16 16:27:19.572893 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 694/1503] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:19 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:20.130829 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:20.131687 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:20.138705 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:20.139167 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:20.139971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:20.140408 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:20.287123 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:20.294934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7efb554b-642c-4fea-b746-e890a1cdca26 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.167719 Nov 16 16:27:20.295517 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 810/1504] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:20 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:20.597214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:20.598956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:20.607333 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:20.607778 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:20.608607 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:20.609039 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:20.749390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:20.759272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:20.760753 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:20.761986 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-eaf28569-4b67-46c8-90b5-a2bb037ed763 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.170202 Nov 16 16:27:20.762886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 695/1505] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:20 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:21.313332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:21.313968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:21.321168 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:21.321636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:21.322497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:21.322957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:21.475706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:21.483899 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a0d23026-b00d-4f8d-b4ec-cd376a12942e tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.174426 Nov 16 16:27:21.484795 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 811/1506] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:21 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:21.780710 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:21.781335 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:21.788504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:21.789079 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:21.790071 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:21.790548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:21.930906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:21.939475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:21.940994 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:21.942243 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0c6928e4-d22b-4269-8131-104b990854aa tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.165321 Nov 16 16:27:21.949329 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 696/1507] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:21 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:22.501234 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:22.501999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:22.509653 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:22.510108 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:22.510929 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:22.511363 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:22.648167 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:22.656467 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8249c29a-76ec-4a07-aba3-26004fd0bbf0 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.158949 Nov 16 16:27:22.657086 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 812/1508] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:22 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:22.963148 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:22.963722 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:22.970261 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:22.970750 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:22.971523 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:22.971956 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:23.122776 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:23.131363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:23.132940 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:23.134796 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-64fbe3f0-bef5-4a28-bd2c-97b000f2337d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.177242 Nov 16 16:27:23.135572 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 697/1509] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:22 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:23.673281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:23.673848 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:23.682267 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:23.682740 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:23.683519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:23.683954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:23.828464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:23.836494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f6bc9f40-903b-4ca2-a6b5-5b5aafe175b1 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.167085 Nov 16 16:27:23.837022 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 813/1510] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:23 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:24.154530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:24.155159 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:24.161943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:24.162404 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:24.163216 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:24.163655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:24.312257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:24.320672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:24.322160 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:24.323379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-de751f12-f953-4d6f-96f8-825019d4db32 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.172718 Nov 16 16:27:24.323950 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 698/1511] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:24 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:24.858611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:24.859192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:24.866211 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:24.866683 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:24.867447 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:24.867870 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:25.015365 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:25.022930 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d676f607-7002-4909-88fa-82dd5dc5769a tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.168027 Nov 16 16:27:25.023501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 814/1512] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:24 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:25.341844 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:25.342802 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:25.349547 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:25.350310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:25.351352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:25.351951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:25.487516 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:25.496162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:25.497720 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:25.499088 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b1b60b38-b3b2-4e82-bb80-5e80084123a3 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.161127 Nov 16 16:27:25.499928 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 699/1513] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:25 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:26.042873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:26.043998 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:26.049993 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:26.050455 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:26.051231 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:26.051654 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:26.202992 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:26.211053 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8a3655f5-e38a-4f2f-ac04-aa3183875465 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.173356 Nov 16 16:27:26.211636 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 815/1514] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:26 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:27:26.523501 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:26.524531 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:26.532332 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:26.532752 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:26.533530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:26.533957 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:26.688798 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:26.705963 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:26.708446 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:26.710401 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e8edd317-7b1e-4f0c-9860-959d9de8f074 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.192926 Nov 16 16:27:26.711194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 700/1515] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:26 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:27.228227 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:27.228985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:27.235917 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:27.236366 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:27.237147 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:27.237585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:27.379048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:27.391406 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a5cd7678-045d-41b5-b71c-a57def6309d9 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.166669 Nov 16 16:27:27.392144 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 816/1516] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:27 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:27.731246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:27.731882 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:27.738618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:27.739062 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:27.739848 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:27.740266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:27.885015 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:27.897268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:27.899986 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:27.901331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-584c40a5-b2d6-4d50-a4da-32455d5a4c2a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.174651 Nov 16 16:27:27.901904 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 701/1517] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:27 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:28.412379 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:28.412944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:28.420094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:28.420540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:28.421316 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:28.421751 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:28.566518 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:28.574470 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4bb44ad3-08b4-4b58-9809-d9fc5c4eaf46 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.165840 Nov 16 16:27:28.575036 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 817/1518] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:28 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:28.923272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:28.923897 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:28.932513 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:28.932987 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:28.933809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:28.934268 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:29.146636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:29.156763 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:29.158258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:29.159482 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-346d3225-5f22-456f-ad47-bfeb127d2ec8 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.242116 Nov 16 16:27:29.170530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 702/1519] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:28 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:29.592132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:29.593912 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:29.601417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:29.601855 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:29.602680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:29.603744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:29.853851 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:29.861585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-61b90404-ad76-43a3-a2f0-11d8555cad11 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.273453 Nov 16 16:27:29.862400 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 818/1520] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:29 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:30.181284 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:30.182163 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:30.190023 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:30.190575 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:30.191467 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:30.191965 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:30.330202 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:30.339766 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:30.341267 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:30.342492 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-5fd75f5f-bbab-4cd1-bdb8-dc8d07c9d82c tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.167745 Nov 16 16:27:30.343080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 703/1521] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:30 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:27:30.882972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:30.884421 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:30.895750 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:30.896519 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:30.897791 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:30.898537 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:31.052640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:31.062046 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7d8e239b-1358-48b3-a04c-0dd130a214b5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.185690 Nov 16 16:27:31.062656 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 819/1522] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:30 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:31.368128 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:31.368775 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:31.375630 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:31.376086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:31.376871 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:31.377301 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:31.538036 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:31.547609 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:31.549181 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:31.550347 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a8821856-8cb7-4a5f-9ecc-de761ea434f4 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.186023 Nov 16 16:27:31.550943 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 704/1523] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:31 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:32.088731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:32.090528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:32.102739 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:32.103449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:32.104340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:32.104773 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:32.254612 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:32.263323 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-74c1ceb0-799f-48ae-8caa-78745ddd4e07 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.186321 Nov 16 16:27:32.263894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 820/1524] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:32 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:32.568723 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:32.569441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:32.576658 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:32.577104 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:32.577879 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:32.578343 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:32.716653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:32.724408 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:32.725906 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:32.727087 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-13b87687-a758-42f6-9274-0d6c988801df tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.162184 Nov 16 16:27:32.727655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 705/1525] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:32 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:33.285332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:33.286048 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:33.293262 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:33.293798 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:33.294715 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:33.295235 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:33.435375 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:33.443281 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8e432346-c2d3-4d7c-a332-b3612d042219 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.161970 Nov 16 16:27:33.443813 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 821/1526] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:33 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:33.746975 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:33.747527 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:33.754247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:33.754733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:33.755577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:33.756006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:33.906653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:33.914542 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:33.916069 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:33.917340 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2c957da6-de3f-49c8-976a-c72605ac88d1 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.174743 Nov 16 16:27:33.917907 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 706/1527] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:33 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:34.460609 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:34.461201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:34.467628 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:34.468074 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:34.468867 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:34.469305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:34.525888 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-49bcfecb-2100-46f8-98d5-cdb98d1f6997 req-b886b8a7-ad59-41b1-9884-49abb59c6b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ef9489-0006-48d1-bc60-cd24f39a8565", "name": "network-vif-plugged", "status": "completed", "tag": "f3a5ab22-3b7f-4e40-9d02-b50b04e13c8c"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:34.527863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:34.527863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:27:34.534998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-49bcfecb-2100-46f8-98d5-cdb98d1f6997 req-b886b8a7-ad59-41b1-9884-49abb59c6b58 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:34.535551 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-49bcfecb-2100-46f8-98d5-cdb98d1f6997 req-b886b8a7-ad59-41b1-9884-49abb59c6b58 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:34.548661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-49bcfecb-2100-46f8-98d5-cdb98d1f6997 req-b886b8a7-ad59-41b1-9884-49abb59c6b58 service nova] Creating event network-vif-plugged:f3a5ab22-3b7f-4e40-9d02-b50b04e13c8c for instance 03ef9489-0006-48d1-bc60-cd24f39a8565 on hv-cinder-78776 Nov 16 16:27:34.553809 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-49bcfecb-2100-46f8-98d5-cdb98d1f6997 req-b886b8a7-ad59-41b1-9884-49abb59c6b58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031822 Nov 16 16:27:34.554805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 707/1528] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:27:34.609005 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:34.617229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a338fa49-2495-4bd4-b042-b3bf286cc436 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.160496 Nov 16 16:27:34.618233 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 822/1529] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:34 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:34.938863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:34.939471 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:34.946318 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:34.946819 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:34.947602 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:34.948033 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:35.095769 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:35.103854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:35.105322 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:35.106502 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3d78ff23-7827-4dee-9eb0-94038554adb5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.172801 Nov 16 16:27:35.107060 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 708/1530] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:34 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:35.640252 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:35.641211 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:35.651507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:35.651954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:35.652737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:35.653204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:35.802172 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:35.814057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8bc8a91f-fbc1-4580-a58d-2f6cad9bc0c5 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1314 microversion: 2.1 time: 0.180402 Nov 16 16:27:35.814943 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 823/1531] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:35 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:36.125503 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:36.126927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:36.134749 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:36.135728 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:36.136623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:36.137124 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:36.280936 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:36.289191 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:36.290767 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:36.292048 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-56b5cdc0-8dbd-4d6f-af0d-0333433e66ad tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.170386 Nov 16 16:27:36.292620 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 709/1532] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:36 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:36.577702 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-33fbbbfa-5c76-49e2-8831-1c5464054a4f req-8ab61016-f887-4f98-bc96-1e10ce748f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee31bfd-6eb9-42f2-86b4-f6de92582bd6", "name": "network-vif-plugged", "status": "completed", "tag": "1371c66f-3f9f-467f-8620-20b01c600c30"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:36.579404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:36.579404 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:27:36.587397 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-33fbbbfa-5c76-49e2-8831-1c5464054a4f req-8ab61016-f887-4f98-bc96-1e10ce748f68 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:36.588119 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-33fbbbfa-5c76-49e2-8831-1c5464054a4f req-8ab61016-f887-4f98-bc96-1e10ce748f68 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:36.599976 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-33fbbbfa-5c76-49e2-8831-1c5464054a4f req-8ab61016-f887-4f98-bc96-1e10ce748f68 service nova] Creating event network-vif-plugged:1371c66f-3f9f-467f-8620-20b01c600c30 for instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 on hv-cinder-78776 Nov 16 16:27:36.606192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-33fbbbfa-5c76-49e2-8831-1c5464054a4f req-8ab61016-f887-4f98-bc96-1e10ce748f68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033680 Nov 16 16:27:36.606991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 824/1533] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:27:36.831418 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:36.832065 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:36.839177 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:36.839628 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:36.840412 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:36.840854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:36.987093 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:36.995256 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-9683098b-4504-40b2-9ad6-c800ca8e1b08 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1464 microversion: 2.1 time: 0.167630 Nov 16 16:27:36.995824 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 710/1534] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:36 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:37.038275 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:37.038912 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:37.048516 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:37.049090 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:37.050234 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:37.050865 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:37.077433 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:27:37.158608 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ae7670ef-f790-4ee5-91e9-ddb545901fba tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 204 len: 0 microversion: 2.1 time: 0.127344 Nov 16 16:27:37.159154 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 825/1535] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:27:37 2021] DELETE /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:27:37.167733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:37.168358 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:37.174830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:37.175274 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:37.176041 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:37.176469 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:37.311849 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:37.312700 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:37.319405 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:37.319868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:37.320682 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:37.321149 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:37.330082 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:37.337891 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-29278eac-e3f7-46d4-b061-6444612831b3 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1470 microversion: 2.1 time: 0.174200 Nov 16 16:27:37.338472 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 711/1536] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:37 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:37.475219 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:37.487919 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:37.490172 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:37.491761 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8484f3c1-58ec-4b62-ad07-bce6e8137501 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.184429 Nov 16 16:27:37.492340 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 826/1537] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:37 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:38.357320 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:38.357973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:38.364733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:38.365176 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:38.365949 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:38.366346 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:38.510228 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:38.512320 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:38.512997 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:38.520051 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:38.520494 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:38.521294 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:38.521830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:38.524789 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ff19f8ff-4a2b-4232-8409-dc22cc2e6b34 tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1470 microversion: 2.1 time: 0.172410 Nov 16 16:27:38.541381 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 712/1538] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:38 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1470 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:38.668528 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:38.677097 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:38.678663 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:38.679922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1b1fda64-e41c-40b9-b742-4f590b897aa5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1732 microversion: 2.20 time: 0.172302 Nov 16 16:27:38.680478 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 827/1539] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:38 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:39.547703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:39.548351 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:39.554960 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:39.555405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:39.556185 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:39.556616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:39.654115 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fd141b9ee3f4b9497a61a516b0f0a7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72e5c6e5706e4b7ead082ca6eab239c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:39.662486 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-38878e14-17ff-47f9-8d24-feb0824dcc7b tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 200 len: 1428 microversion: 2.1 time: 0.118586 Nov 16 16:27:39.663169 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 713/1540] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:39 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:27:39.692130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-bb12182f-b0bd-420a-8863-12e89fdde0e8 req-bae63a53-6b3e-4246-897c-98f6e0d74ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03ef9489-0006-48d1-bc60-cd24f39a8565", "name": "network-vif-deleted", "tag": "f3a5ab22-3b7f-4e40-9d02-b50b04e13c8c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:27:39.694166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:27:39.694166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:27:39.705041 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:39.708334 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-bb12182f-b0bd-420a-8863-12e89fdde0e8 req-bae63a53-6b3e-4246-897c-98f6e0d74ea0 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:39.709016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:39.712409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-bb12182f-b0bd-420a-8863-12e89fdde0e8 req-bae63a53-6b3e-4246-897c-98f6e0d74ea0 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:39.721200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:39.721651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:39.722640 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:39.723078 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:39.735590 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-bb12182f-b0bd-420a-8863-12e89fdde0e8 req-bae63a53-6b3e-4246-897c-98f6e0d74ea0 service nova] Creating event network-vif-deleted:f3a5ab22-3b7f-4e40-9d02-b50b04e13c8c for instance 03ef9489-0006-48d1-bc60-cd24f39a8565 on hv-cinder-78776 Nov 16 16:27:39.740754 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-bb12182f-b0bd-420a-8863-12e89fdde0e8 req-bae63a53-6b3e-4246-897c-98f6e0d74ea0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052382 Nov 16 16:27:39.741666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 828/1541] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:27:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:27:39.921451 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:39.929930 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:39.931504 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:27:39.932761 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-0a2bf4ce-a393-43ef-ad91-ebc0b6226251 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1719 microversion: 2.20 time: 0.234563 Nov 16 16:27:39.933321 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 714/1542] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:27:39 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:27:40.682153 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:27:40.683046 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] [instance: 03ef9489-0006-48d1-bc60-cd24f39a8565] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:27:40.690610 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:40.691134 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:40.692050 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:27:40.692555 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:27:40.707246 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] HTTP exception thrown: Instance 03ef9489-0006-48d1-bc60-cd24f39a8565 could not be found. Nov 16 16:27:40.707817 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] Returning 404 to user: Instance 03ef9489-0006-48d1-bc60-cd24f39a8565 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:27:40.708657 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-651ea51c-19ff-43a2-84e8-2d23dc1d78fa tempest-VolumesNegativeTest-691189824 tempest-VolumesNegativeTest-691189824-project] 10.222.0.61 "GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565" status: 404 len: 111 microversion: 2.1 time: 0.031510 Nov 16 16:27:40.709182 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 829/1543] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:27:40 2021] GET /compute/v2.1/servers/03ef9489-0006-48d1-bc60-cd24f39a8565 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:28:35.405985 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-76718b09-73f3-4396-8b09-c853bcc754fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:35.406908 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-76718b09-73f3-4396-8b09-c853bcc754fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:35.413915 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76718b09-73f3-4396-8b09-c853bcc754fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:35.414370 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76718b09-73f3-4396-8b09-c853bcc754fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:35.415174 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76718b09-73f3-4396-8b09-c853bcc754fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:35.415623 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-76718b09-73f3-4396-8b09-c853bcc754fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:35.449541 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-76718b09-73f3-4396-8b09-c853bcc754fc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047415 Nov 16 16:28:35.450123 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 715/1544] 10.222.0.61 () {60 vars in 1342 bytes} [Tue Nov 16 16:28:35 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:28:35.512828 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:35.513449 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:35.520045 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:35.520485 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:35.521297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:35.521711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:35.547853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Going to try to terminate instance {{(pid=116167) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:28:35.627881 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-bc80a140-f5dc-41d8-a267-0cafb6e88db5 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 204 len: 0 microversion: 2.20 time: 0.118758 Nov 16 16:28:35.628591 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 830/1545] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Nov 16 16:28:35 2021] DELETE /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:28:35.637744 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:35.638282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:35.644390 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:35.644837 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:35.645604 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:35.646035 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:35.788886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:35.798595 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:35.800195 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:35.801363 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dab1d9c9-8657-4a68-834e-27e7f751f34f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.167776 Nov 16 16:28:35.801923 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 716/1546] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:28:35 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 16 16:28:36.827922 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:36.828629 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:36.836984 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:36.837429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:36.838486 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:36.839102 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:36.980121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:36.990358 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:36.991954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:36.993131 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8e281f98-a7d0-414d-acb3-01bd5b0b8a5a tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1725 microversion: 2.20 time: 0.170503 Nov 16 16:28:36.993692 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 831/1547] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:28:36 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:28:38.013608 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:38.014239 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:38.020785 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:38.021270 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:38.022051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:38.022899 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:38.090653 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:38.098771 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:38.100279 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '389db5ee5d9d4d59bf15b3b4001bfce1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b74019a568aa4ba6aa5af9147f1e9c72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:28:38.101455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a746971b-a143-4518-891a-f6303d472751 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 200 len: 1657 microversion: 2.20 time: 0.091699 Nov 16 16:28:38.101997 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 717/1548] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:28:38 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 1657 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 16 16:28:38.294738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-96ab7973-96b1-43fe-ab56-c20b2a92db6d req-913de866-05eb-4495-874c-c0cb937f9df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ee31bfd-6eb9-42f2-86b4-f6de92582bd6", "name": "network-vif-deleted", "tag": "1371c66f-3f9f-467f-8620-20b01c600c30"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:28:38.297980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:28:38.297980 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:28:38.313278 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-96ab7973-96b1-43fe-ab56-c20b2a92db6d req-913de866-05eb-4495-874c-c0cb937f9df9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:38.317447 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-96ab7973-96b1-43fe-ab56-c20b2a92db6d req-913de866-05eb-4495-874c-c0cb937f9df9 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:38.330994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-96ab7973-96b1-43fe-ab56-c20b2a92db6d req-913de866-05eb-4495-874c-c0cb937f9df9 service nova] Creating event network-vif-deleted:1371c66f-3f9f-467f-8620-20b01c600c30 for instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 on hv-cinder-78776 Nov 16 16:28:38.339012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-96ab7973-96b1-43fe-ab56-c20b2a92db6d req-913de866-05eb-4495-874c-c0cb937f9df9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049931 Nov 16 16:28:38.340173 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 832/1549] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:28:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:28:39.120816 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:39.121544 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:39.129212 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:39.129644 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:39.130497 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:39.130935 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:39.146311 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] HTTP exception thrown: Instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 could not be found. Nov 16 16:28:39.147016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Returning 404 to user: Instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:28:39.147882 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7cdcc9eb-1ca2-47a9-9b18-f0ae1ad95dfc tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 404 len: 111 microversion: 2.20 time: 0.031114 Nov 16 16:28:39.148466 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 718/1550] 10.222.0.61 () {60 vars in 1276 bytes} [Tue Nov 16 16:28:39 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 16 16:28:39.158292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d7781129-76e8-44fe-8cea-30c1d7fb879f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '.version_select at 0x7f3ec368ea60>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:39.178925 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d7781129-76e8-44fe-8cea-30c1d7fb879f tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535398336" status: 204 len: 0 microversion: 2.20 time: 0.025243 Nov 16 16:28:39.179590 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 833/1551] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Nov 16 16:28:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535398336 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 16 16:28:41.153273 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:41.153854 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:41.162333 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:41.162811 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:41.163593 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:41.164027 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:41.178423 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] HTTP exception thrown: Instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 could not be found. Nov 16 16:28:41.179013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Returning 404 to user: Instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:28:41.180204 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-440f42a8-2558-4840-9840-16f2ee72fa56 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 404 len: 111 microversion: 2.1 time: 0.033092 Nov 16 16:28:41.180732 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 719/1552] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:28:41 2021] DELETE /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:28:41.191144 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:41.191861 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:41.198816 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:41.199298 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:41.200046 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:41.200543 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:41.214017 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] HTTP exception thrown: Instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 could not be found. Nov 16 16:28:41.214672 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Returning 404 to user: Instance 0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:28:41.215531 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-b08bc0ed-781a-4079-8977-084822a77416 tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6" status: 404 len: 111 microversion: 2.1 time: 0.030303 Nov 16 16:28:41.216064 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 834/1553] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:28:41 2021] GET /compute/v2.1/servers/0ee31bfd-6eb9-42f2-86b4-f6de92582bd6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:28:42.358352 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:42.358935 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:42.367193 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:42.367633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:42.368415 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:42.369007 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:42.383639 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] HTTP exception thrown: Instance be607369-0706-46d3-9745-8e5549afb1ec could not be found. Nov 16 16:28:42.384309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Returning 404 to user: Instance be607369-0706-46d3-9745-8e5549afb1ec could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:28:42.385140 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-063fb64e-0223-4ca9-bf87-e3ffe62fb80d tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "DELETE /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 404 len: 111 microversion: 2.1 time: 0.030689 Nov 16 16:28:42.385659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 720/1554] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:28:42 2021] DELETE /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:28:42.394070 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:28:42.394706 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] [instance: be607369-0706-46d3-9745-8e5549afb1ec] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:28:42.401731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:42.402185 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:42.403157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:28:42.403595 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:28:42.418376 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] HTTP exception thrown: Instance be607369-0706-46d3-9745-8e5549afb1ec could not be found. Nov 16 16:28:42.419000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] Returning 404 to user: Instance be607369-0706-46d3-9745-8e5549afb1ec could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:28:42.419834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d0781781-51ba-4a5d-983a-debca4537bbe tempest-AttachVolumeShelveTestJSON-1729565493 tempest-AttachVolumeShelveTestJSON-1729565493-project] 10.222.0.61 "GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec" status: 404 len: 111 microversion: 2.1 time: 0.029703 Nov 16 16:28:42.420390 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 835/1555] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:28:42 2021] GET /compute/v2.1/servers/be607369-0706-46d3-9745-8e5549afb1ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:29:11.239105 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:11.239705 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:11.244453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-b8f6e281-bdf7-403a-ba53-3d474b5bf1dc req-5d85d402-4ad9-41d2-8b5e-5da8282ab84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb95e3f-aa14-4dc0-921f-1b5890e099a9", "tag": "ce557352-37ed-45c9-9e08-6192caa333f3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:29:11.248165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:29:11.248165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:29:11.255845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-b8f6e281-bdf7-403a-ba53-3d474b5bf1dc req-5d85d402-4ad9-41d2-8b5e-5da8282ab84e service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:11.257156 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:11.257777 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-b8f6e281-bdf7-403a-ba53-3d474b5bf1dc req-5d85d402-4ad9-41d2-8b5e-5da8282ab84e service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:11.258302 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:11.259130 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:11.259550 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:11.272671 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-b8f6e281-bdf7-403a-ba53-3d474b5bf1dc req-5d85d402-4ad9-41d2-8b5e-5da8282ab84e service nova] Creating event network-changed:ce557352-37ed-45c9-9e08-6192caa333f3 for instance 4fb95e3f-aa14-4dc0-921f-1b5890e099a9 on hv-cinder-78776 Nov 16 16:29:11.279305 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-b8f6e281-bdf7-403a-ba53-3d474b5bf1dc req-5d85d402-4ad9-41d2-8b5e-5da8282ab84e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042156 Nov 16 16:29:11.288640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 836/1556] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:29:11.295969 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:29:11.428778 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-216dfc9a-c744-473c-ae63-6c047b7b5a18 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 204 len: 0 microversion: 2.1 time: 0.196128 Nov 16 16:29:11.430364 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 721/1557] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:29:11 2021] DELETE /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:29:11.441031 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:11.442546 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:11.452653 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:11.453333 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:11.455015 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:11.456213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:11.712322 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:11.719802 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-cb2b5a32-4c4c-420e-a929-a49aa7169440 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1576 microversion: 2.1 time: 0.284682 Nov 16 16:29:11.730414 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 837/1558] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:11 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1576 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:12.740120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:12.741061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:12.748383 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:12.748833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:12.749605 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:12.750083 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:12.897708 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:12.905553 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-d96efeb9-c5ea-45ee-8c82-b7b937294350 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1457 microversion: 2.1 time: 0.169808 Nov 16 16:29:12.906162 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 722/1559] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:12 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1457 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:13.891451 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-152797b3-0fd1-4c7b-94ff-400457371a92 req-0dfad59b-a20f-41b3-8991-31fd46011df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb95e3f-aa14-4dc0-921f-1b5890e099a9", "name": "network-vif-deleted", "tag": "ce557352-37ed-45c9-9e08-6192caa333f3"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:29:13.893068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:29:13.893068 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:29:13.900819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-152797b3-0fd1-4c7b-94ff-400457371a92 req-0dfad59b-a20f-41b3-8991-31fd46011df1 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:13.901268 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-152797b3-0fd1-4c7b-94ff-400457371a92 req-0dfad59b-a20f-41b3-8991-31fd46011df1 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:13.913121 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-152797b3-0fd1-4c7b-94ff-400457371a92 req-0dfad59b-a20f-41b3-8991-31fd46011df1 service nova] Creating event network-vif-deleted:ce557352-37ed-45c9-9e08-6192caa333f3 for instance 4fb95e3f-aa14-4dc0-921f-1b5890e099a9 on hv-cinder-78776 Nov 16 16:29:13.919809 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-152797b3-0fd1-4c7b-94ff-400457371a92 req-0dfad59b-a20f-41b3-8991-31fd46011df1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032102 Nov 16 16:29:13.920465 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 838/1560] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:29:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:29:13.924491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:13.925118 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:13.933826 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:13.934269 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:13.935103 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:13.935537 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:14.007636 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:14.015524 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3980fd9d-1abb-4465-b7c0-3b3238732da6 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 200 len: 1226 microversion: 2.1 time: 0.095701 Nov 16 16:29:14.016117 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 723/1561] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:13 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:15.039557 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:15.040241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4fb95e3f-aa14-4dc0-921f-1b5890e099a9] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:15.047067 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:15.047505 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:15.048268 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:15.048696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:15.062088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] HTTP exception thrown: Instance 4fb95e3f-aa14-4dc0-921f-1b5890e099a9 could not be found. Nov 16 16:29:15.062695 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Returning 404 to user: Instance 4fb95e3f-aa14-4dc0-921f-1b5890e099a9 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:29:15.063512 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-21739bbf-789e-4c68-af4f-f649cabe9b30 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9" status: 404 len: 111 microversion: 2.1 time: 0.030846 Nov 16 16:29:15.064041 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 839/1562] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:15 2021] GET /compute/v2.1/servers/4fb95e3f-aa14-4dc0-921f-1b5890e099a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:29:18.177070 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:18.177898 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:18.178360 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-15c93629-75d9-4a46-b850-50afa5966152 req-2c0ca6c7-d2fe-4261-b8e3-15a23afce242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172b0d0e-bc3e-43e0-9546-70e6878ac676", "tag": "64517ff5-93e6-4ccb-bf07-d2fe293d9e6c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:29:18.180547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:29:18.180547 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:29:18.186419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:18.187183 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:18.188089 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-15c93629-75d9-4a46-b850-50afa5966152 req-2c0ca6c7-d2fe-4261-b8e3-15a23afce242 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:18.188232 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:18.188591 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:18.189009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-15c93629-75d9-4a46-b850-50afa5966152 req-2c0ca6c7-d2fe-4261-b8e3-15a23afce242 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:18.202010 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-15c93629-75d9-4a46-b850-50afa5966152 req-2c0ca6c7-d2fe-4261-b8e3-15a23afce242 service nova] Creating event network-changed:64517ff5-93e6-4ccb-bf07-d2fe293d9e6c for instance 172b0d0e-bc3e-43e0-9546-70e6878ac676 on hv-cinder-78776 Nov 16 16:29:18.207498 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-15c93629-75d9-4a46-b850-50afa5966152 req-2c0ca6c7-d2fe-4261-b8e3-15a23afce242 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032897 Nov 16 16:29:18.210949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 840/1563] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:29:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:29:18.221862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:29:18.338168 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-756c1f38-58ba-4b49-bfbc-d3cf1534f2ad tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "DELETE /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 204 len: 0 microversion: 2.1 time: 0.166285 Nov 16 16:29:18.343003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 724/1564] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:29:18 2021] DELETE /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:29:18.348217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:18.349171 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:18.357493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:18.358755 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:18.360071 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:18.360748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:18.635853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:18.647157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1e871589-f4ce-47cf-bd38-aa4a0db83bef tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1577 microversion: 2.1 time: 0.302778 Nov 16 16:29:18.648439 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 841/1565] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:18 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1577 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:29:19.667493 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:19.668240 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:19.675640 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:19.676111 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:19.676913 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:19.677368 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:19.816404 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:19.824490 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8afe7dc5-e88d-4a9f-8f4e-299fb6e6a79b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1458 microversion: 2.1 time: 0.161482 Nov 16 16:29:19.825062 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 725/1566] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:19 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:20.488150 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-240e6b29-d130-43e0-8cf9-41a4e67dff4f req-cc742154-a514-4efc-8361-fc0858ec752a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172b0d0e-bc3e-43e0-9546-70e6878ac676", "name": "network-vif-deleted", "tag": "64517ff5-93e6-4ccb-bf07-d2fe293d9e6c"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:29:20.489811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:29:20.489811 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:29:20.498544 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-240e6b29-d130-43e0-8cf9-41a4e67dff4f req-cc742154-a514-4efc-8361-fc0858ec752a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:20.498995 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-240e6b29-d130-43e0-8cf9-41a4e67dff4f req-cc742154-a514-4efc-8361-fc0858ec752a service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:20.512071 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-240e6b29-d130-43e0-8cf9-41a4e67dff4f req-cc742154-a514-4efc-8361-fc0858ec752a service nova] Creating event network-vif-deleted:64517ff5-93e6-4ccb-bf07-d2fe293d9e6c for instance 172b0d0e-bc3e-43e0-9546-70e6878ac676 on hv-cinder-78776 Nov 16 16:29:20.517000 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-240e6b29-d130-43e0-8cf9-41a4e67dff4f req-cc742154-a514-4efc-8361-fc0858ec752a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033533 Nov 16 16:29:20.517587 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 842/1567] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:29:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:29:20.843246 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:20.844407 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:20.852072 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:20.852624 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:20.853397 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:20.854051 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:20.891097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:20.891635 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:20.892229 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.objects.instance [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lazy-loading 'fault' on Instance uuid 172b0d0e-bc3e-43e0-9546-70e6878ac676 {{(pid=116168) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:29:20.941550 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd94e07e5a7d49398e9118053fc13c69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '497aa262344a4be5a0fd2fb5e66015c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:20.949526 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-dc874c4d-cf86-4cd8-a42c-39c8506823c2 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 200 len: 1231 microversion: 2.1 time: 0.109945 Nov 16 16:29:20.950102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 726/1568] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:20 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 1231 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:21.969436 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:21.970887 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 172b0d0e-bc3e-43e0-9546-70e6878ac676] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:21.978239 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:21.978717 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:21.979507 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:21.979940 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:21.994744 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] HTTP exception thrown: Instance 172b0d0e-bc3e-43e0-9546-70e6878ac676 could not be found. Nov 16 16:29:21.995332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Returning 404 to user: Instance 172b0d0e-bc3e-43e0-9546-70e6878ac676 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:29:21.996370 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a83be13c-8e85-4b7b-a5bc-ba9dfc19b05d tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676" status: 404 len: 111 microversion: 2.1 time: 0.032071 Nov 16 16:29:21.996991 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 843/1569] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:21 2021] GET /compute/v2.1/servers/172b0d0e-bc3e-43e0-9546-70e6878ac676 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 16 16:29:22.524806 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:22.525370 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:22.531859 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:22.532313 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:22.533129 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:22.533555 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:22.548247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.wsgi [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] HTTP exception thrown: Instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 could not be found. Nov 16 16:29:22.548998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Returning 404 to user: Instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 could not be found. {{(pid=116168) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:29:22.549913 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-4b48825e-c5f3-461a-a5fb-0cb5b29db9c8 tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 404 len: 111 microversion: 2.1 time: 0.029048 Nov 16 16:29:22.553548 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 727/1570] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:29:22 2021] DELETE /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:29:22.558974 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:22.559876 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] [instance: 4f3ec58d-75c6-423a-a57c-8769a0efd6b0] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:22.566330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:22.566808 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:22.567731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:22.568170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:22.585979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] HTTP exception thrown: Instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 could not be found. Nov 16 16:29:22.586859 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Returning 404 to user: Instance 4f3ec58d-75c6-423a-a57c-8769a0efd6b0 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:29:22.587979 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2213528e-b10d-4396-8c9a-5adfde9ed3ab tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0" status: 404 len: 111 microversion: 2.1 time: 0.032863 Nov 16 16:29:22.588768 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 844/1571] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:22 2021] GET /compute/v2.1/servers/4f3ec58d-75c6-423a-a57c-8769a0efd6b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:29:23.958325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-03473107-704e-4488-be7c-cf64730d5d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] Calling method '.version_select at 0x7f3ec36baca0>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:23.986194 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-03473107-704e-4488-be7c-cf64730d5d7b tempest-TestVolumeBootPattern-327132008 tempest-TestVolumeBootPattern-327132008-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1284105524" status: 202 len: 0 microversion: 2.1 time: 0.031803 Nov 16 16:29:23.987558 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 728/1572] 10.222.0.61 () {58 vars in 1262 bytes} [Tue Nov 16 16:29:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1284105524 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:29:43.063644 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-57d955b2-7e1c-4b8d-af4b-8c02f3c4546d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Action: 'create', calling method: .version_select at 0x7f3ec36b3790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-871939313"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:29:43.085130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-57d955b2-7e1c-4b8d-af4b-8c02f3c4546d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Getting quotas for project 7255eabd42d8478985d7cb609e2112a0. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:29:43.089734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-57d955b2-7e1c-4b8d-af4b-8c02f3c4546d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Getting quotas for user e6dee85763734b43a3d96f3cf687a018 and project 7255eabd42d8478985d7cb609e2112a0. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:29:43.203878 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-57d955b2-7e1c-4b8d-af4b-8c02f3c4546d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Getting quotas for project 7255eabd42d8478985d7cb609e2112a0. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:29:43.207479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.quota [None req-57d955b2-7e1c-4b8d-af4b-8c02f3c4546d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Getting quotas for user e6dee85763734b43a3d96f3cf687a018 and project 7255eabd42d8478985d7cb609e2112a0. Resources: {'key_pairs'} {{(pid=116167) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:29:43.221972 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-57d955b2-7e1c-4b8d-af4b-8c02f3c4546d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.164187 Nov 16 16:29:43.222607 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 845/1573] 10.222.0.61 () {60 vars in 1157 bytes} [Tue Nov 16 16:29:43 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:43.331356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2019162758", "imageRef": "53d9eb26-5e01-4cc0-9039-35ee839e91ba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-871939313", "networks": [{"uuid": "2ab25ff2-9319-4706-917a-92f0e5cd057f"}]}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:29:43.385976 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.network.neutron [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] validate_networks() for [('2ab25ff2-9319-4706-917a-92f0e5cd057f', None, None, None, None, None)] {{(pid=116168) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 16 16:29:43.895962 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Flavor limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 16 16:29:43.896379 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Image limits 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 16 16:29:43.896840 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Flavor pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 16 16:29:43.897263 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Image pref 0:0:0 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 16 16:29:43.897661 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.virt.hardware [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116168) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 16 16:29:43.907414 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:43.907797 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:43.908611 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:43.909205 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:43.925905 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Getting quotas for project 7255eabd42d8478985d7cb609e2112a0. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 16 16:29:43.930620 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.quota [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Getting quotas for user e6dee85763734b43a3d96f3cf687a018 and project 7255eabd42d8478985d7cb609e2112a0. Resources: {'instances', 'ram', 'cores'} {{(pid=116168) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 16 16:29:43.941997 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Going to run 1 instances... {{(pid=116168) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 16 16:29:43.944292 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='53d9eb26-5e01-4cc0-9039-35ee839e91ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116168) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 16 16:29:43.989747 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [79246576-bd86-4025-b052-2e43e1f510ae] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 16 16:29:45.013940 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [79246576-bd86-4025-b052-2e43e1f510ae] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 43662. Nov 16 16:29:45.018200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8a96ece2-34e4-4062-b6dd-53a11ef84321 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.691189 Nov 16 16:29:45.018862 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 729/1574] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Nov 16 16:29:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 1692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 16 16:29:45.031033 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e868767e-4721-4dd8-be07-2d3dc21b650b tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:45.031845 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e868767e-4721-4dd8-be07-2d3dc21b650b tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:45.096584 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e868767e-4721-4dd8-be07-2d3dc21b650b tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:45.104804 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e868767e-4721-4dd8-be07-2d3dc21b650b tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1258 microversion: 2.1 time: 0.079336 Nov 16 16:29:45.105389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 846/1575] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:45 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:46.122911 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-6cbffe43-69a8-45be-b539-f41e3979e3f7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:46.123508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-6cbffe43-69a8-45be-b539-f41e3979e3f7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:46.174493 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-6cbffe43-69a8-45be-b539-f41e3979e3f7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:46.181427 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-6cbffe43-69a8-45be-b539-f41e3979e3f7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1258 microversion: 2.1 time: 0.063040 Nov 16 16:29:46.182000 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 730/1576] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:46 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1258 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:47.198450 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-94b2771b-58b9-4b55-b310-f7910ad3b9d7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:47.199482 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-94b2771b-58b9-4b55-b310-f7910ad3b9d7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:47.269136 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-94b2771b-58b9-4b55-b310-f7910ad3b9d7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:47.276030 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-94b2771b-58b9-4b55-b310-f7910ad3b9d7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1258 microversion: 2.1 time: 0.081464 Nov 16 16:29:47.276769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 847/1577] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:47 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:48.297247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-997b1254-7b33-4c48-8959-299418e3e1d6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:48.298165 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-997b1254-7b33-4c48-8959-299418e3e1d6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:48.354720 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-997b1254-7b33-4c48-8959-299418e3e1d6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:48.362075 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-997b1254-7b33-4c48-8959-299418e3e1d6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1258 microversion: 2.1 time: 0.071298 Nov 16 16:29:48.371925 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 731/1578] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:48 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:49.379735 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:49.380341 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:49.388311 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:49.388771 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:49.389776 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:49.390295 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:49.450217 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:49.458125 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-f06fd222-d8fc-4801-bdc5-1f17312cc2da tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1262 microversion: 2.1 time: 0.082190 Nov 16 16:29:49.458732 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 848/1579] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:49 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:50.475863 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:50.476473 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:50.484285 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:50.484739 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:50.485712 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:50.486325 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:50.559240 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:50.568523 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-3e523ca0-997e-4da9-b56d-09f6ec962046 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1316 microversion: 2.1 time: 0.096301 Nov 16 16:29:50.569903 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 732/1580] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:50 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1316 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:51.586066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:51.586871 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:51.593582 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:51.594092 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:51.594994 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:51.595492 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:51.736130 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:51.743838 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-80d7c5af-7f0c-446f-adf6-9637b840419e tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.161600 Nov 16 16:29:51.744413 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 849/1581] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:51 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:52.762689 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:52.764665 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:52.771579 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:52.772026 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:52.772885 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:52.773308 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:52.911763 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:52.919175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-ad3779f2-ccda-41e7-9597-3150f964797f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.160998 Nov 16 16:29:52.919716 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 733/1582] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:52 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:53.937913 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:53.938752 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:53.946579 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:53.946957 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:53.947783 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:53.948203 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:54.092804 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:54.100933 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8978fc1d-1348-4d74-8380-5b0d664727ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.167829 Nov 16 16:29:54.101594 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 850/1583] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:53 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:55.118935 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:55.119942 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:55.126782 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:55.127230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:55.128013 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:55.128441 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:55.292833 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:55.303134 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a675d8c1-d97c-45a0-ab06-70090e1c1751 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.187472 Nov 16 16:29:55.314328 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 734/1584] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:55 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:56.320115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:56.320711 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:56.327529 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:56.327973 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:56.329154 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:56.329559 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:56.479536 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:56.487453 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-d8c39ce7-671d-41d7-825a-0a2e12b37f98 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.171191 Nov 16 16:29:56.488030 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 851/1585] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:56 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:57.504668 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:57.505282 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:57.511948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:57.512476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:57.513339 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:57.513985 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:57.667158 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:57.674817 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-b055e2ef-d8ea-4a8c-adcd-4ae043aad7a7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.174676 Nov 16 16:29:57.675419 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 735/1586] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:57 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:58.692332 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:58.693162 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:58.699969 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:58.700416 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:58.701201 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:58.701625 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:58.872686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:29:58.880895 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-78f97888-5906-431e-b489-0fb51f062a52 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.193042 Nov 16 16:29:58.881728 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 852/1587] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:58 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:29:59.898861 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:29:59.899532 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:29:59.906070 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:59.906560 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:29:59.907344 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:29:59.907951 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:00.045779 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:00.055052 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e7095f39-d76f-4cae-a790-2a3e8f69ca7c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.159857 Nov 16 16:30:00.065491 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 736/1588] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:29:59 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:01.082928 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:01.084012 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:01.094618 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:01.095359 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:01.096806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:01.097357 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:01.250670 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:01.259665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ba5a1f02-de43-48d3-ba26-2676b3e754b3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.189107 Nov 16 16:30:01.260232 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 853/1589] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:01 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:02.276926 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:02.277591 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:02.284470 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:02.284932 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:02.285706 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:02.286134 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:02.429546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:02.440927 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-2c8ed2bf-c17b-43bd-96cd-4884d8ba6339 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.167484 Nov 16 16:30:02.441651 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 737/1590] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:02 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:03.458580 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:03.459179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:03.466223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:03.466697 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:03.467501 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:03.467934 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:03.685083 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:03.693593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-7aea319f-412d-4d3f-b712-9fad2f09adc9 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.239001 Nov 16 16:30:03.695863 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 854/1591] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:03 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:03.886309 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-ee4e51e5-b9ad-4dac-80bd-c5b6c6589993 req-f35a42e3-9b0b-4831-ba66-92ff4c894106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fd1154-9ff3-4d5d-a0ae-f912c3245090", "tag": "e1871afc-af01-4243-b987-ec8e91278970"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:30:03.891356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:30:03.891356 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:30:03.904090 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-ee4e51e5-b9ad-4dac-80bd-c5b6c6589993 req-f35a42e3-9b0b-4831-ba66-92ff4c894106 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:03.904669 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-ee4e51e5-b9ad-4dac-80bd-c5b6c6589993 req-f35a42e3-9b0b-4831-ba66-92ff4c894106 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:03.920682 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-ee4e51e5-b9ad-4dac-80bd-c5b6c6589993 req-f35a42e3-9b0b-4831-ba66-92ff4c894106 service nova] Creating event network-changed:e1871afc-af01-4243-b987-ec8e91278970 for instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 on hv-cinder-78776 Nov 16 16:30:03.926003 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-ee4e51e5-b9ad-4dac-80bd-c5b6c6589993 req-f35a42e3-9b0b-4831-ba66-92ff4c894106 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043685 Nov 16 16:30:03.926830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 738/1592] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:30:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:30:04.710115 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:04.710786 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:04.716947 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:04.717389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:04.718143 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:04.718806 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:04.943836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:04.951888 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-5a435e77-8257-4f55-8cf6-7f23856adb6f tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.245544 Nov 16 16:30:04.952458 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 855/1593] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:04 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:05.974880 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:05.975987 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:05.986576 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:05.987319 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:05.988266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:05.988702 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:06.137546 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:06.146080 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-557bf61a-f507-4a69-af73-203956af1994 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.178948 Nov 16 16:30:06.146808 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 739/1594] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:05 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:07.163681 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:07.164292 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:07.171600 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:07.171985 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:07.172774 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:07.173210 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:07.323997 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:07.333374 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0a6698c4-c736-4e48-b920-f3d25e470809 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.173498 Nov 16 16:30:07.333988 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 856/1595] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:07 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:08.351170 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:08.351827 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:08.358333 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:08.358820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:08.359599 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:08.360029 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:08.495200 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:08.503004 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fcb0516b-e865-4ea8-9b09-b91e2b879f96 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.155666 Nov 16 16:30:08.503554 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 740/1596] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:08 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:09.523170 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:09.523782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:09.530958 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:09.531422 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:09.532223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:09.532653 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:09.668568 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:09.676088 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8da686e9-8b58-4c82-84a0-ab07680349f3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.157883 Nov 16 16:30:09.676658 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 857/1597] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:09 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:10.695619 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:10.696252 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:10.703703 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:10.704199 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:10.705061 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:10.705549 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:10.844614 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:10.854097 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-8f79f30b-a329-43f0-96eb-504543dd3661 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.163674 Nov 16 16:30:10.854735 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 741/1598] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:10 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:11.168646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-830b37b2-e438-4bdc-881a-a9ed245ba1fa req-16d28b38-51a9-4e4a-b1f0-ae561a1f7eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd1154-9ff3-4d5d-a0ae-f912c3245090", "name": "network-vif-plugged", "status": "completed", "tag": "e1871afc-af01-4243-b987-ec8e91278970"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:30:11.170276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:30:11.170276 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:30:11.179593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-830b37b2-e438-4bdc-881a-a9ed245ba1fa req-16d28b38-51a9-4e4a-b1f0-ae561a1f7eff service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:11.180044 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-830b37b2-e438-4bdc-881a-a9ed245ba1fa req-16d28b38-51a9-4e4a-b1f0-ae561a1f7eff service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:11.191592 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-830b37b2-e438-4bdc-881a-a9ed245ba1fa req-16d28b38-51a9-4e4a-b1f0-ae561a1f7eff service nova] Creating event network-vif-plugged:e1871afc-af01-4243-b987-ec8e91278970 for instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 on hv-cinder-78776 Nov 16 16:30:11.196646 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-830b37b2-e438-4bdc-881a-a9ed245ba1fa req-16d28b38-51a9-4e4a-b1f0-ae561a1f7eff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031907 Nov 16 16:30:11.197257 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 858/1599] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:30:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:30:11.871640 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:11.872255 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:11.879092 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:11.879530 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:11.880331 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:11.880766 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:12.023886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:12.031946 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7b7d9a36-78e1-482b-84d4-1c69a6f0c4ef tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1358 microversion: 2.1 time: 0.164145 Nov 16 16:30:12.032522 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 742/1600] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:11 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:13.049954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:13.050666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:13.057916 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.058330 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.059188 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.059613 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.191882 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:13.200280 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-538e562b-a2bc-4ca5-acdf-0f25793d8950 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1548 microversion: 2.1 time: 0.154411 Nov 16 16:30:13.201230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 859/1601] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:13 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:13.216797 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:13.217412 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:13.223971 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.224437 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.225214 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.225640 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.365047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:13.372595 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-09a4372f-bc6a-475b-86d1-e23caa602d11 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1548 microversion: 2.1 time: 0.159413 Nov 16 16:30:13.373175 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 743/1602] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:13 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:13.389022 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:13.392567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:30:13.392567 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:30:13.393564 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:13.394306 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Searching by: {'deleted': False, 'project_id': '7255eabd42d8478985d7cb609e2112a0'} {{(pid=116167) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 16 16:30:13.404285 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.404734 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.405532 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.405954 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.495057 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.multi_cell_list [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116167) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 16 16:30:13.585314 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-007aefdf-e294-4f48-ad19-03fbd05dda08 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199888 Nov 16 16:30:13.586282 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 860/1603] 10.222.0.61 () {58 vars in 1124 bytes} [Tue Nov 16 16:30:13 2021] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 16 16:30:13.596086 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:13.596690 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:13.602794 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.603230 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.603980 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:13.604405 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:13.736238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:13.743830 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-28749944-b039-4f21-a23b-714ff4c3a001 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1548 microversion: 2.1 time: 0.151383 Nov 16 16:30:13.744399 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 744/1604] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:13 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:15.285353 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-4b6a328c-8ee6-4130-92f0-c292d003f2fd tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00049216-2f82-4740-aa42-01008bff1504"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:30:15.286396 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-4b6a328c-8ee6-4130-92f0-c292d003f2fd tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:15.293297 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b6a328c-8ee6-4130-92f0-c292d003f2fd tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:15.293737 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b6a328c-8ee6-4130-92f0-c292d003f2fd tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:15.294540 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b6a328c-8ee6-4130-92f0-c292d003f2fd tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:15.294966 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-4b6a328c-8ee6-4130-92f0-c292d003f2fd tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:15.564834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-4b6a328c-8ee6-4130-92f0-c292d003f2fd tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283011 Nov 16 16:30:15.566593 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 861/1605] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Nov 16 16:30:15 2021] POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:30:19.649830 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:30:19.650921 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: Tue Nov 16 16:30:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:30:23.158167 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:23.158805 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:23.165659 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:23.166139 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:23.166947 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:23.167378 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:23.318340 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:23.327385 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-68373d50-c179-42e0-a7c3-be9fdc5c5fd6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1594 microversion: 2.1 time: 0.172847 Nov 16 16:30:23.327931 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 745/1606] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:23 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1594 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:25.092389 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-1c1ecab2-da96-4938-aea1-48f2ff86166d req-6781f142-1dd3-48ef-b899-09f7b4074d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fd1154-9ff3-4d5d-a0ae-f912c3245090", "tag": "e1871afc-af01-4243-b987-ec8e91278970"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:30:25.093944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:30:25.093944 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:30:25.103073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1c1ecab2-da96-4938-aea1-48f2ff86166d req-6781f142-1dd3-48ef-b899-09f7b4074d62 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:25.103801 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-1c1ecab2-da96-4938-aea1-48f2ff86166d req-6781f142-1dd3-48ef-b899-09f7b4074d62 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:25.115291 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-1c1ecab2-da96-4938-aea1-48f2ff86166d req-6781f142-1dd3-48ef-b899-09f7b4074d62 service nova] Creating event network-changed:e1871afc-af01-4243-b987-ec8e91278970 for instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 on hv-cinder-78776 Nov 16 16:30:25.120874 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-1c1ecab2-da96-4938-aea1-48f2ff86166d req-6781f142-1dd3-48ef-b899-09f7b4074d62 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032937 Nov 16 16:30:25.121866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 862/1607] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:30:26.107633 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1238957163"}} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:30:26.108228 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:26.114772 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:26.115224 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:26.115998 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:26.116431 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:26.248733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.network.security_group_api [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Adding security group 2962886f-ef33-4c1e-8b9c-a91f9cefc167 to port e1871afc-af01-4243-b987-ec8e91278970 Nov 16 16:30:26.605983 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-c5e48c46-b49a-4d36-b806-fa4fbdd2946d tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/action" status: 202 len: 0 microversion: 2.1 time: 0.502171 Nov 16 16:30:26.606954 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 746/1608] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:30:26 2021] POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:30:26.617213 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:30:26.618093 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:30:26.625001 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:26.625643 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:26.632014 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:26.632666 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:26.801002 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:30:26.811748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-2b6035e7-cc9c-4d45-ac95-f7e640428928 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1759 microversion: 2.1 time: 0.199971 Nov 16 16:30:26.812451 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 863/1609] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:30:26 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1759 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:30:27.137693 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-40217365-f402-4c49-8f04-18edef5c0a70 req-dd80ac12-cde7-477f-b003-22b4c5352426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fd1154-9ff3-4d5d-a0ae-f912c3245090", "tag": "e1871afc-af01-4243-b987-ec8e91278970"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:30:27.139311 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:30:27.139311 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:30:27.146596 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-40217365-f402-4c49-8f04-18edef5c0a70 req-dd80ac12-cde7-477f-b003-22b4c5352426 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:30:27.147102 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-40217365-f402-4c49-8f04-18edef5c0a70 req-dd80ac12-cde7-477f-b003-22b4c5352426 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:30:27.159190 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-40217365-f402-4c49-8f04-18edef5c0a70 req-dd80ac12-cde7-477f-b003-22b4c5352426 service nova] Creating event network-changed:e1871afc-af01-4243-b987-ec8e91278970 for instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 on hv-cinder-78776 Nov 16 16:30:27.164535 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-40217365-f402-4c49-8f04-18edef5c0a70 req-dd80ac12-cde7-477f-b003-22b4c5352426 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031256 Nov 16 16:30:27.165375 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 747/1610] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:30:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:31:27.255165 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-243c2148-fa1f-44be-8cb1-ed2cfa0fec89 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:31:27.256920 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-243c2148-fa1f-44be-8cb1-ed2cfa0fec89 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:27.266898 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-243c2148-fa1f-44be-8cb1-ed2cfa0fec89 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:27.267515 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-243c2148-fa1f-44be-8cb1-ed2cfa0fec89 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:27.268611 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-243c2148-fa1f-44be-8cb1-ed2cfa0fec89 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:27.269220 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-243c2148-fa1f-44be-8cb1-ed2cfa0fec89 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:27.340419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-243c2148-fa1f-44be-8cb1-ed2cfa0fec89 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/action" status: 202 len: 0 microversion: 2.1 time: 0.092977 Nov 16 16:31:27.341038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 864/1611] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:31:27 2021] POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:31:27.353706 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:27.354424 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:27.360941 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:27.361373 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:27.362136 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:27.362618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:27.742114 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:27.750611 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-bd97e7c7-8753-4709-ae09-495ed724e7e4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1751 microversion: 2.1 time: 0.402761 Nov 16 16:31:27.751188 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 748/1612] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:27 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1751 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 16 16:31:28.773901 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:28.774769 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:28.781429 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:28.781877 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:28.782696 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:28.783127 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:29.004632 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:29.013585 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-e4ce5255-811c-417b-bae7-127ecd999131 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.246895 Nov 16 16:31:29.014155 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 865/1613] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:28 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:30.032591 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:30.033288 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:30.040774 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:30.041226 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:30.042006 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:30.042474 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:30.205592 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:30.214475 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-515dd232-4c28-4f4d-9445-11ffbe757bba tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.185946 Nov 16 16:31:30.215040 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 749/1614] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:30 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:31.236066 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:31.236738 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:31.245782 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:31.246229 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:31.247065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:31.247497 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:31.411941 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:31.420315 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-76ec3ca5-a6a7-45ed-b19c-8da65abd3979 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.190438 Nov 16 16:31:31.420872 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 866/1615] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:31 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:32.441735 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:32.442810 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:32.453610 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:32.454367 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:32.455683 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:32.456410 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:32.612028 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:32.620886 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-33e67b13-6006-4a70-8c87-403fcb3454b7 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.185346 Nov 16 16:31:32.621461 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 750/1616] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:32 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:33.642495 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:33.643423 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:33.654242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:33.655027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:33.656318 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:33.657027 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:33.832815 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:33.841535 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-46e8d490-ab89-4da6-a5d6-09a3de880328 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.205415 Nov 16 16:31:33.842094 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 867/1617] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:33 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:34.860712 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:34.861406 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:34.868989 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:34.869429 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:34.870198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:34.870660 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:35.033186 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:35.042577 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-a6486649-27b8-4a77-92d8-d06ce106b7ed tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.186118 Nov 16 16:31:35.043183 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 751/1618] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:34 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:36.062549 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:36.063157 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:36.069668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:36.070110 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:36.071065 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:36.071685 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:36.225834 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:36.234244 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-73ce187a-0bca-4f3c-b113-af968bbda4b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.176299 Nov 16 16:31:36.234892 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 868/1619] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:36 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:37.255672 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:37.257066 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:37.264476 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:37.264920 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:37.265688 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:37.266113 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:37.434731 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:37.443403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-7e4e285f-f1a5-45b3-9c63-0518b93e7681 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.193888 Nov 16 16:31:37.443952 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 752/1620] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:37 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:38.461959 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:38.462680 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:38.469748 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:38.470195 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:38.471009 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:38.471464 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:38.635479 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:38.647110 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-93f835ef-56d3-41cf-a74d-b86adac63e25 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1756 microversion: 2.1 time: 0.188772 Nov 16 16:31:38.647866 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 869/1621] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:38 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:31:39.667618 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:31:39.668201 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:31:39.675060 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:39.675505 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:39.676272 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:31:39.676706 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:31:39.832870 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:31:39.841798 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-f9d0be20-475b-412f-bc23-d3ca702f18d4 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1759 microversion: 2.1 time: 0.179132 Nov 16 16:31:39.842438 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 753/1622] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:31:39 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:32:11.512016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:32:11.513238 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: Tue Nov 16 16:32:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:32:43.183204 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1238957163"}} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:32:43.183873 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:43.190192 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:43.190661 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:43.191484 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:43.191904 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:43.423069 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.network.security_group_api [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Removing security group 2962886f-ef33-4c1e-8b9c-a91f9cefc167 from port e1871afc-af01-4243-b987-ec8e91278970 Nov 16 16:32:43.918286 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-1131e185-9223-4a68-b521-159bb5d0aa6c tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/action" status: 202 len: 0 microversion: 2.1 time: 0.739655 Nov 16 16:32:43.922417 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 870/1623] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Nov 16 16:32:43 2021] POST /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/action => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:32:44.025741 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [req-0dc295cd-b048-482e-8a0d-68b12e3eb1fe req-b5d6698a-0e72-4246-8b33-c0e0ae4f0d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fd1154-9ff3-4d5d-a0ae-f912c3245090", "tag": "e1871afc-af01-4243-b987-ec8e91278970"}]} {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:32:44.028151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:32:44.028151 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: warnings.warn(msg) Nov 16 16:32:44.036403 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-0dc295cd-b048-482e-8a0d-68b12e3eb1fe req-b5d6698a-0e72-4246-8b33-c0e0ae4f0d40 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:44.037085 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [req-0dc295cd-b048-482e-8a0d-68b12e3eb1fe req-b5d6698a-0e72-4246-8b33-c0e0ae4f0d40 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:44.053258 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.compute.server_external_events [req-0dc295cd-b048-482e-8a0d-68b12e3eb1fe req-b5d6698a-0e72-4246-8b33-c0e0ae4f0d40 service nova] Creating event network-changed:e1871afc-af01-4243-b987-ec8e91278970 for instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 on hv-cinder-78776 Nov 16 16:32:44.059733 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [req-0dc295cd-b048-482e-8a0d-68b12e3eb1fe req-b5d6698a-0e72-4246-8b33-c0e0ae4f0d40 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136122 Nov 16 16:32:44.061047 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 754/1624] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:32:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:32:45.617179 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:45.617867 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:45.624522 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:45.624999 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:45.625915 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:45.626337 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:45.706242 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.objects.instance [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lazy-loading 'services' on Instance uuid a0fd1154-9ff3-4d5d-a0ae-f912c3245090 {{(pid=116167) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 16 16:32:45.781189 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-ff7da456-d692-4ac7-a9be-f5256d1a6da0 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments/00049216-2f82-4740-aa42-01008bff1504" status: 202 len: 0 microversion: 2.1 time: 0.168699 Nov 16 16:32:45.781787 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 871/1625] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:32:45 2021] DELETE /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments/00049216-2f82-4740-aa42-01008bff1504 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:32:45.791507 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-e937591d-3e05-4ee0-8424-0bafaf535fe6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:45.792529 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-e937591d-3e05-4ee0-8424-0bafaf535fe6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:45.806788 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e937591d-3e05-4ee0-8424-0bafaf535fe6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:45.807719 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e937591d-3e05-4ee0-8424-0bafaf535fe6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:45.808744 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e937591d-3e05-4ee0-8424-0bafaf535fe6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:45.809409 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-e937591d-3e05-4ee0-8424-0bafaf535fe6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:45.841455 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-e937591d-3e05-4ee0-8424-0bafaf535fe6 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055053 Nov 16 16:32:45.842310 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 755/1626] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:32:45 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:32:46.075836 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-4340a993-13c9-4d5a-8f34-28287124eebc req-448860d8-18cc-43fd-a154-3feea82bcbfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fd1154-9ff3-4d5d-a0ae-f912c3245090", "tag": "e1871afc-af01-4243-b987-ec8e91278970"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:32:46.077382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:32:46.077382 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:32:46.084894 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-4340a993-13c9-4d5a-8f34-28287124eebc req-448860d8-18cc-43fd-a154-3feea82bcbfb service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:46.085264 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-4340a993-13c9-4d5a-8f34-28287124eebc req-448860d8-18cc-43fd-a154-3feea82bcbfb service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:46.096419 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-4340a993-13c9-4d5a-8f34-28287124eebc req-448860d8-18cc-43fd-a154-3feea82bcbfb service nova] Creating event network-changed:e1871afc-af01-4243-b987-ec8e91278970 for instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 on hv-cinder-78776 Nov 16 16:32:46.101541 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-4340a993-13c9-4d5a-8f34-28287124eebc req-448860d8-18cc-43fd-a154-3feea82bcbfb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029880 Nov 16 16:32:46.102344 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 872/1627] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:32:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:32:46.853688 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-af494104-5a5d-4fb7-bd0a-981456cf73b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:46.854616 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-af494104-5a5d-4fb7-bd0a-981456cf73b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:46.861445 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af494104-5a5d-4fb7-bd0a-981456cf73b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:46.861827 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af494104-5a5d-4fb7-bd0a-981456cf73b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:46.862631 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af494104-5a5d-4fb7-bd0a-981456cf73b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:46.863056 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-af494104-5a5d-4fb7-bd0a-981456cf73b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:46.892973 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-af494104-5a5d-4fb7-bd0a-981456cf73b1 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043278 Nov 16 16:32:46.893528 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 756/1628] 10.222.0.61 () {58 vars in 1301 bytes} [Tue Nov 16 16:32:46 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 16 16:32:46.907874 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:46.908686 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:46.917360 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:46.917803 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:46.918623 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:46.919053 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:46.993971 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] HTTP exception thrown: Instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 is not attached to volume 00049216-2f82-4740-aa42-01008bff1504 Nov 16 16:32:46.994617 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Returning 404 to user: Instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 is not attached to volume 00049216-2f82-4740-aa42-01008bff1504 {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:32:46.995443 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-a991aa21-c631-49bd-86a8-ed843280ca56 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments/00049216-2f82-4740-aa42-01008bff1504" status: 404 len: 154 microversion: 2.1 time: 0.094956 Nov 16 16:32:46.995949 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 873/1629] 10.222.0.61 () {58 vars in 1415 bytes} [Tue Nov 16 16:32:46 2021] DELETE /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090/os-volume_attachments/00049216-2f82-4740-aa42-01008bff1504 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:32:48.135722 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:48.136245 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:48.143365 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:48.143820 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:48.144600 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:48.145032 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:48.170679 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Going to try to terminate instance {{(pid=116168) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 16 16:32:48.259693 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-beaed90e-f98e-4e6f-bd56-d5103bda7020 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 204 len: 0 microversion: 2.1 time: 0.127362 Nov 16 16:32:48.260247 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 757/1630] 10.222.0.61 () {58 vars in 1238 bytes} [Tue Nov 16 16:32:48 2021] DELETE /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 16 16:32:48.268665 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:48.269284 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:48.275968 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:48.276437 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:48.277211 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:48.277640 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:48.415853 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.policy [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116167) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:32:48.424317 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-8ab2170a-e2c3-4839-af31-492a64e449e2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1554 microversion: 2.1 time: 0.159357 Nov 16 16:32:48.424874 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 874/1631] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:32:48 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:32:49.447257 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:49.448266 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:49.458948 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:49.459655 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:49.460919 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:49.461588 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:49.606277 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:32:49.613970 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-61038e3b-2b70-4434-ada7-db4a0caa04d3 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1554 microversion: 2.1 time: 0.173789 Nov 16 16:32:49.614582 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 758/1632] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:32:49 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:32:50.570241 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [req-b0dd63f9-20e5-4a9d-b487-5019f4bf37a0 req-b60b0680-a571-4c6e-97bd-01a726958c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd1154-9ff3-4d5d-a0ae-f912c3245090", "name": "network-vif-deleted", "tag": "e1871afc-af01-4243-b987-ec8e91278970"}]} {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 16 16:32:50.571965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 16:32:50.571965 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: warnings.warn(msg) Nov 16 16:32:50.580132 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-b0dd63f9-20e5-4a9d-b487-5019f4bf37a0 req-b60b0680-a571-4c6e-97bd-01a726958c74 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:50.581187 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [req-b0dd63f9-20e5-4a9d-b487-5019f4bf37a0 req-b60b0680-a571-4c6e-97bd-01a726958c74 service nova] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:50.592310 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.compute.server_external_events [req-b0dd63f9-20e5-4a9d-b487-5019f4bf37a0 req-b60b0680-a571-4c6e-97bd-01a726958c74 service nova] Creating event network-vif-deleted:e1871afc-af01-4243-b987-ec8e91278970 for instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 on hv-cinder-78776 Nov 16 16:32:50.597819 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [req-b0dd63f9-20e5-4a9d-b487-5019f4bf37a0 req-b60b0680-a571-4c6e-97bd-01a726958c74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031196 Nov 16 16:32:50.598493 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 875/1633] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Nov 16 16:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 16 16:32:50.631892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:50.632508 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.compute.api [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116168) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:50.639286 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:50.639645 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:50.640413 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:50.640892 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG oslo_concurrency.lockutils [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116168) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:50.712120 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.policy [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6dee85763734b43a3d96f3cf687a018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7255eabd42d8478985d7cb609e2112a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116168) authorize /opt/stack/nova/nova/policy.py:199}} Nov 16 16:32:50.720346 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-98fe94ed-6b41-4990-a787-f029a13705b2 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 200 len: 1343 microversion: 2.1 time: 0.092594 Nov 16 16:32:50.720910 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 759/1634] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:32:50 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 1343 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 16 16:32:51.742694 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '>' {{(pid=116167) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:51.743868 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.compute.api [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] [instance: a0fd1154-9ff3-4d5d-a0ae-f912c3245090] Fetching instance by UUID {{(pid=116167) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 16 16:32:51.751073 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:51.751513 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:51.752303 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 16 16:32:51.752731 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG oslo_concurrency.lockutils [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Lock "539e9b60-8ce1-4f2b-9153-f282c518691a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116167) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 16 16:32:51.766668 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.wsgi [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] HTTP exception thrown: Instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 could not be found. Nov 16 16:32:51.767251 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: DEBUG nova.api.openstack.wsgi [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Returning 404 to user: Instance a0fd1154-9ff3-4d5d-a0ae-f912c3245090 could not be found. {{(pid=116167) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 16 16:32:51.768081 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO nova.api.openstack.requestlog [None req-0d2d5ad6-5045-4837-b412-7cd544bbf331 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090" status: 404 len: 111 microversion: 2.1 time: 0.032682 Nov 16 16:32:51.768633 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: [pid: 116167|app: 0|req: 876/1635] 10.222.0.61 () {58 vars in 1235 bytes} [Tue Nov 16 16:32:51 2021] GET /compute/v2.1/servers/a0fd1154-9ff3-4d5d-a0ae-f912c3245090 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 16 16:32:51.777100 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: DEBUG nova.api.openstack.wsgi [None req-fb949f3b-0128-45c5-b6aa-530d4fbf2904 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] Calling method '.version_select at 0x7f3ec3628940>' {{(pid=116168) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 16 16:32:51.803198 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO nova.api.openstack.requestlog [None req-fb949f3b-0128-45c5-b6aa-530d4fbf2904 tempest-TestMinimumBasicScenario-1756256494 tempest-TestMinimumBasicScenario-1756256494-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-871939313" status: 202 len: 0 microversion: 2.1 time: 0.029485 Nov 16 16:32:51.804007 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: [pid: 116168|app: 0|req: 760/1636] 10.222.0.61 () {58 vars in 1268 bytes} [Tue Nov 16 16:32:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-871939313 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 16 16:33:00.787409 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:33:00.788061 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: Tue Nov 16 16:33:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:33:39.674077 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:33:39.675260 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: Tue Nov 16 16:33:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:35:21.088583 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:35:21.089424 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: Tue Nov 16 16:35:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:35:31.541072 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:35:31.542042 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: Tue Nov 16 16:35:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:35:38.048791 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:35:38.050016 dv-cinder-787764-5-iscsi devstack@n-api.service[116168]: Tue Nov 16 16:35:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:35:46.097338 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:35:46.098355 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: Tue Nov 16 16:35:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:36:20.807038 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:36:20.808223 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: Tue Nov 16 16:36:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 16 16:36:59.703166 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 16 16:36:59.704230 dv-cinder-787764-5-iscsi devstack@n-api.service[116167]: Tue Nov 16 16:36:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!